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Chapter  1 
Introduction 


The  problem  of  weak  signal  detection  in  non-Gaussian  noise  is  of  interest  to  engineers 
in  many  disciplines  such  as  radar,  sonar,  digital  communications  and  radio  astronomy. 
In  this  research,  we  are  interested  in  the  detection  of  weadc  radar  targets  in  a  strong 
clutter  background.  When  a  signal  is  transmitted  by  a  radar,  the  resulting  received 
signal  consists  of  returns  from  a  target  (desired  signal)  and  returns  from  such  objects 
as  buildings,  trees,  water,  land  and  weather,  depending  on  the  environment.  Any 
return  other  than  that  from  the  target  is  an  unwanted  signal  and  is  defined  as  radar 
clutter. 

The  fundamental  issues  that  need  to  be  addressed  are: 

(1)  Specification  of  suitable  statistical  models  for  the  clutter  back¬ 
ground. 

(2)  Development  of  eflBcient  computer  simulation  procedures  for  gen¬ 
erating  samples  characterized  by  the  various  statistical  models. 

(3)  Development  of  an  identification  procedure  for  fitting  one  or  more 
statistical  models  to  a  set  of  experimental  data. 

With  respect  to  item  (1),  a  complete  statistical  clutter  model  should  provide  us  with 
a  closed  form  analytical  expression  for  the  probability  density  function  (PDF)  of  the 
clutter.  This  should  include  information  about  the  correlation  of  the  clutter,  thereby 
enabling  us  to  take  advantage  of  this  correlation  in  order  to  cancel  the  clutter.  We 
are  interested  in  processing  either  N  complex  samples  or  2N  quadrature  components 
obtained  by  sampling  a  complex  random  process  which  has  a  non-Rayleigh  envelope 
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PDF  and  a  phase  that  is  uniformly  distributed  over  the  interval  (0, 25r).  In  addition, 
it  is  assumed  that  the  envelope  and  the  phase  are  statistically  independent.  We 
can  think  of  a  vector  Y  =  [Yd,  ...Ycn,  3^,1...^,^]^  to  represent  the  collection 
of  the  complex  samples  that  have  been  obtained  by  sampling  the  complex  process. 
The  subscripts  c  and  s  denote  the  inphase  and  out  of  phase  quadrature  components, 
respectively.  The  issue  that  we  need  to  address  is  the  specification  of  the  joint  PDF  of 
the  N  complex  samples  or  the  2N  quadrature  components.  In  other  words,  we  need 
to  specify  the  PDF  of  the  vector  Y.  We  require  that  the  multivariate  probability 
density  functions  be  specified  in  closed  form  to  facilitate  their  use  in  the  derivation 
of  optimail  radeir  signal  processors. 

For  each  PDF  of  Y  that  is  developed,  we  need  to  obtain  an  eflacient  computer  sim¬ 
ulation  scheme  for  generating  random  vectors  having  this  PDF.  Computer  simulation 
is  necessary  because  it  is  likely  that  it  will  not  be  possible  to  evaluate  analytically 
the  performance  of  optimal  non-Gaussian  radar  receivers.  In  such  cases,  performance 
must  be  evaluated  by  computer  simulation. 

More  often  than  not,  the  background  clutter  is  not  known  a  priori.  Also,  the 
parameters  of  the  clutter  are  unknown.  Therefore,  we  need  to  develop  estimation 
procedures  to  approximate  the  clutter  PDF  and  its  parameters.  We  need  to  address 
the  problem  of  distribution  identification  and  parameter  estimation.  It  is  desirable  to 
have  available  an  extensive  list  of  possible  multivariate  probability  density  functions 
so  that  a  good  fit  can  be  found  for  a  given  environment.  In  practice,  only  a  small 
number  of  samples  may  be  available.  Therefore,  there  is  a  need  to  develop  efficient 
procedures  to  handle  small  sample  sizes. 

Because  the  clutter  is  apt  to  change  in  space  and  time,  the  radar  signal  processor 
must  be  adaptive  to  meet  the  changing  conditions.  The  approach  proposed  here 
for  the  characterization,  computer  generation  cind  distribution  identification  of  the 
clutter  based  on  the  theory  of  spherically  invariant  random  processes  lends  itself  to 
adaptive  receivers. 

This  dissertation  addresses  the  above  issues  and  is  organized  as  follows.  In  Chapter 
2  we  present  a  review  of  the  literature  as  it  pertains  to  the  modeling  of  radar  clutter  as 
a  spherically  invariant  random  process.  Chapter  3  presents  techniques  for  obtaining 
the  joint  PDF  of  N  complex,  non-Gaussian,  random  variables,  assuming  that  the 
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clutter  can  be  characterized  as  a  spherically  invariant  random  process.  The  need  for  a 
library  of  multivariate  non-Gaussian  PDFs  is  discussed.  Several  examples  illustrating 
the  various  techniques  for  specifying  the  multivariate  non-Gaussian  PDF  are  provided. 
Finally,  a  key  result  useful  for  identifying  the  multivariate  non-Gaussian  PDFs  arising 
from  sphericcilly  invariant  random  processes  is  presented  in  Chapter  3. 

Chapter  4  deals  with  the  problem  of  computer  generation  of  correlated  non-Gaussian 
radar  clutter  that  can  be  characterized  as  a  spherically  invariant  random  process. 
Two  canonical  simulation  procedures  are  presented.  A  graphical  goodness  of  fit  test 
procedure  is  presented,  to  validate  the  simulation  procedures. 

In  Chapter  5  we  concern  ourselves  with  the  distribution  identification  of  radar  clut¬ 
ter  characterized  by  spherically  invariant  random  processes.  A  new  graphical  scheme 
based  on  a  key  result  presented  in  Chapter  3  is  used  to  address  the  distribution  identi¬ 
fication  problem.  This  procedure  reduces  the  multivariate  distribution  identification 
problem  to  an  equivalent  univariate  distribution  identification  problem,  resulting  in 
considerable  computational  simplicity.  Finally,  a  new  technique  for  shape  parameter 
estimation  is  suggested  based  on  the  identification  procedure.  The  chief  advantage  of 
this  scheme  is  that  relatively  few  samples  are  needed  for  the  distribution  identification 
problem. 

Conclusions  and  suggestions  for  future  research  are  presented  in  Chapter  6. 
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Chapter  2 
Background 


2.1  Introduction 

We  present  an  overview  of  the  literature  as  it  pertains  to  the  modeling  of  radar 
clutter  by  spherically  inveiriant  random  processes.  In  addition,  relevant  mathematical 
preliminaries  are  presented  in  this  chapter.  When  a  radar  transmits  a  signal,  the 
received  echo  may  consist  of  returns  from  one  or  more  targets,  buildings,  trees,  water, 
land  and  weather  depending  on  the  environment.  The  target  returns  contribute  to  the 
desired  signal  while  the  other  returns  contribute  to  the  clutter.  Many  investigators 
[1,  2,  3,  4]  have  reported  experimental  measurements  for  which  the  clutter  probability 
density  function  has  an  extended  tail.  The  extended  tail  gives  rise  to  relatively  large 
probabilities  of  false  alarm.  The  Gaussian  model  for  the  clutter  fails  to  predict 
this  behavior.  Two  approaches  have  been  used  to  explain  the  non-Gaussian  behavior. 
One  of  them  is  based  on  the  fact  that  application  of  the  central  limit  theorem  (CLT) 
is  not  appropriate.  The  other  approach  is  based  on  the  nonstationary  reflectivity 
properties  of  the  scanned  areas.  In  any  event,  non-Gaussian  models  for  the  univariate 
(marginal)  clutter  PDF  have  been  proposed.  Commonly  reported  marginal  non- 
Gaussian  PDFs  for  the  clutter  are  Weibull  [1],  log-normal  [5,  6]  and  K-distributions 
[3,  7,  2].  Second  order  statistics  for  these  models  have  been  reported  in  terms  of 
autocorrelation  functions  or  power  spectral  densities  [8,  4]. 

The  Weibull  [1]  and  log-normal  [2]  models  for  radar  clutter  are  primarily  baised 
on  empirical  studies,  while  the  K-distribution  has  been  shown'  to  have  physical  sig¬ 
nificance  [9,  2]  in  that  the  observed  statistical  properties  can  be  related  to  the  elec¬ 
tromagnetic  and  geometric  factors  pertaining  to  the  scattering  surface.  Computer 
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simulation  schemes  for  Weibull  and  Log-normal  clutter  based  on  the  univariate  PDFs 
and  correlation  functions  have  been  developed  in  [10]  and  [11],  respectively.  Exten¬ 
sion  of  the  Weibull  and  Log-normal  and  K-distributed  clutter  models  for  coherent 
radar  processing  have  been  developed  in  [12,  5,  13]  respectively. 

Statistical  characterization  of  the  clutter  is  necessary  in  order  to  obtain  the  optimal 
radar  signal  processor.  Usually,  radars  process  N  pulses  at  a  time.  A  complete  statis¬ 
tical  characterization  of  the  clutter  requires  the  specification  of  the  joint  probability 
density  function  (PDF)  of  the  N  samples.  When  the  pulse  returns  are  statistically 
independent,  the  joint  PDF  is  simply  the  product  of  the  marginal  PDFs.  However, 
the  clutter  can  be  highly  correlated.  In  fact,  the  correlation  between  samples  is  useful 
in  canceling  the  clutter.  Consequently,  it  is  desirable  to  include  the  correlation  infor¬ 
mation  in  the  multivariate  PDF.  For  non-Gaussian  processes  this  can  be  done  in  more 
than  one  way.  The  theory  of  spherically  invariant  random  processes  (SIRP)  provides 
a  powerful  mechanism  for  obtaining  the  joint  PDF  of  the  N  correlated  non-Gaussian 
random  variables.  Applications  for  the  theory  of  SIRPs  can  be  found  in  the  problem 
of  random  flights  [14],  signal  detection  and  estimation  problems  in  communication 
theory  [15,  16],  speech  signal  processing  [17,  18],  radar  clutter  modeling  and  simula¬ 
tion  [19,  13,  20,  21,  22].  The  following  sections  provide  a  brief  overview  of  literature 
on  the  theory  of  SIRPs. 

2.2  Definitions 

In  this  section  we  present  certain  definitions  and  mathematical  preliminaries  per¬ 
taining  to  the  theory  of  SIRPs.  A  random  vector  Y  =  [Vi,  Y2,  .  ■ . ,  Vjv]^>  TV  >  1,  is 
said  to  be  a  spherically  invariant  random  vector  (SIRV)  if  its  PDF  has  the  form 

My)  =  t|rrU„[(y  -  bf  s-'(y  -  b)]  (2.1) 

where  Jfc  is  a  normalization  chosen  so  that  the  volume  under  the  curve  of  the  PDF  is 
unity,  b  is  a  AT  by  1  vector,  E  is  a  AT  by  AT  non-negative  definite  matrix,  and  hN{.)  is 
a  one  dimensional,  non-negative,  real  valued  monotonically  decreasing  function.  Note 
that  the  PDF  of  an  SIRV  is  elliptically  symmetric  (i.e.,  constant  contours  of  /yCy) 
composed  of  ellipses).  If  every  random  vector  obtained  by  sampling  a  random  process 
y{t)  is  a  spherically  invariant  random  vector,  regardless  of  the  sampling  instants  or 
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the  number  of  samples,  then  the  process  y{t)  is  defined  to  be  a  spherically  invariant 
random  process  (SIRP). 

Kingman  [14]  introduced  the  definition  of  spherically  symmetric  random  vectors 
(SSRV).  In  particular,  a  random  vector  X  =  [Xi,  X2,  • . .  said  to  be  spheri¬ 

cally  symmetric  provided  its  PDF  has  the  form 

/x(x)  =  khN[{xl  +  x\  +  ...  +  x^)»]  =  (2.2) 

where  is  an  arbitrary,  non- negative,  monotonicaily  decreasing  radial  function 

of  dimension  N  and  A:  is  a  normalization  constant  chosen  so  that  the  volume  under 
the  curve  of  the  PDF  is  unity.  The  subscript  N  is  used  to  emphasize  that  we  are 
dealing  with  N  random  variables.  Throughout  the  manuscript,  it  is  assumed  that 
the  PDF  of  a  random  vector  is  the  joint  PDF  of  its  components.  Equivalently,  if 
(jj  =  [a;i,  0^2,  •  • . »  the  characteristic  function  of  the  SSRV  X  defined  by  = 

£[exp(juj^X)],  has  the  form 

^x(w)  =  -h  +  . . .  +  (2.3) 

where  pjv(.)  is  a  non-negative  conjugate  symmetric  function  which  is  magnitude  inte- 
grable.  An  SSRV  is  a  special  case  of  an  SIRV,  arising  from  eq  (2.1)  when  b  =  0  and 
S  =  I  where  I  is  the  identity  matrix.  In  Appendix  A,  we  prove  that  the  characteristic 
function  of  an  SSRV  is  also  spherically  symmetric. 

2.3  Characterization  of  SIRVs 

In  this  section  we  present  some  important  theorems  that  help  us  to  characterize 
the  PDF  of  a  SIRV.  The  work  of  Yao  [15],  Kingman  [23]  and  Wise  [24]  gave  rise  to 
a  representation  theorem  for  SSRVs.  The  representation  theorem  can  be  stated  as 
follows. 

Theorem  1  A  random  vector  X  =  [Xi,  X2,  . . .  X^]^  is  an  SSRV  for  any  N,  if  and 
only  if  there  exists  a  non-negative  random  variable  T  such  that  the  random  variables 
Xi,  (i  =  1,2, ...W)  conditioned  on  T  =  t  are  independent,  identically  distributed, 
Gaussian  random  variables  with  zero  mean  and  variance  equal  to  2t. 
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Proof:  Necessity:  By  definition,  the  characteristic  function  of  X  is 

=  E[exp{juj'^X)] 

=  Ho  •  •  •  Ho  expOu;^x)/x(x)<fx. 

The  PDF  of  the  random  variable  T  is  introduced  by  noting  that 


/x(x)  =  /x,t(x,  t)dt 

(2.5) 

=  I-co  fx\T{^\t)fT{t)dt. 

Substituting  into  the  expression  for  the  characteristic  function  and  interchanging  the 
order  of  integration  we  obtain 

=  /  ^x\T{^ii)fT{t)dt  (2.6) 

oo 

where 

t)=  f  •  •  •  /  exp{jiJ'x)fx\T{x\t)dx.  (2.7) 

Since  X  is  an  SSRV  for  any  N,  its  characteristic  function  has  the  form  of  eq  (2.3). 
This  requires  that  the  functional  form  of  remain  unchanged  for  all  N. 

Furthermore,  $x|T(‘^i  0  must  also  be  a  function  of  (u;^  +  + . . .  +<^^)  for  any  choice 

of  N.  The  only  characteristic  function  satisfying  these  conditions  [23]  is 

^X\t{(^i  0  =  exp[—t{u)l  +  u;2  +  .  • .  + 1^^)]  (2-8) 

where  the  conditional  PDF  of  X,  given  T  =  t,  is  recognized  to  be  multivariate  Gaus¬ 
sian,  with  Xi,  {i  =  I,  2.,  . . . ,  N)  being  statistically  independent  identically  distributed, 
zero  mean  Gaussian  random  variables  with  variance  2f.  Because  the  variance  equals 
2t,  T  must  be  a  non-negative  random  variable.  Necessity  follows.  Note  that  the 
theorem  does  not  give  any  physical  significance  for  T.  Neither  does  it  reveal  how  to 
determine  /t(0* 

Sufl&ceincy;  To  prove  sufficiency,  we  need  to  show  that  every  product  of  a  Gaussian 
random  vector  Z  having  zero  mean  and  identity  covariance  matrix  and  a  random 
variable  S'  =  \/2r  with  PDF  fs'is)  results  in  a  PDF  of  the  form  of  eq  (2.2). 
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In  particular,  consider  the  product  X  =  ZS".  The  PDF  of  X  conditioned  on  S'  is 
then  given  by 

/x|5'(x|5')  =  (27r)"^is'|"^ea:p(-^j^)  (2.9) 

where  p  =  x^x.  From  the  theorem  on  total  probability,  the  PDF  of  X  can  be  written 
as 

/ 

/x(x)  =  (2x)-^  \s'\-''exp(-^)fs'U‘)ds‘.  (2.10) 

For  convenience,  we  can  write  the  PDF  of  S'  as 

fs'{s)  =  Ms')  +  Ms')  (2.11) 


where 


Ms)  = 


f{s')  s*  >  0 


0  otherwise 


(2.12) 


Ms)  = 


Then,  eq  (2.10)  can  be  expressed  as 


f{s')  s'<0 


0  otherwise 


(2.13) 


/x(x)  =  {2ir)-2  Is'l  ^exp(--^)/2(-s')ds'+(2x)  2 


\s'\-'^exp{-^^)fi{s')ds' 

2\sy 

(2.14) 


Making  the  change  of  variable  —s'  =  ^  in  the  first  integral  of  eq  (2.14),  we  have 

t 

/x(x)  =  (2jr)-^  {s')~^exp{—^^)fs>{s')ds'.  (2.15) 

Thus,  it  is  clear  that  regardless  of  whether  S'  is  positive  or  negative,  the  PDF  of  X 
has  the  form  of  eq  (2.15).  Henceforth,  we  always  consider  the  product  of  Z  and  a 
non-negaitve  random  variable  S  in  our  analysis. 

Comparing  eqs  (2.15)  and  (2.2),  we  can  write  k  —  (2x)~T  and 


t 

Mp')  =  ^  {s)~^exp{—^^)fs>{s')ds'. 


(2.16) 
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Note  that  /i;v(p)  given  by  eq  (2.16)  is  a  non-negative,  monotonically  decreasing  func¬ 
tion  of  p,  for  all  N.  Therefore,  the  PDF  of  eq  (2.15)  is  entirely  equivalent  to  that 
of  eq  (2.2).  This  establishes  the  theorem.  Thus,  it  is  clear  that  the  PDF  of  an 
SSRV  is  uniquely  determined  by  the  specification  of  a  Gaussian  random  vector  hav¬ 
ing  zero  mean  and  identity  covariance  matrix  and  a  first  order  PDF  fs{s)  called  the 
characteristic  PDF. 

The  following  theorem  in  [25]  states  that  a  SIRV  is  related  to  an  SSRV  by  a  linear 
transformation. 

Theorem  2  7/X  is  an  SSRV,  with  characteristic  PDF  fs{s),  then  the  deterministic 
linear  transformation 

Y  =  AX-hb  (2.17) 

results  in  Y  being  an  SIRV  having  the  same  characteristic  PDF.  It  is  required  that  A 
be  a  matrix  such  that  A.AF  is  nonsingular  and  h  be  an  N  by  1  vector. 

Proof:  Since  X  is  an  SSRV,  we  can  express  X  as  X  =  ZS",  where  Z  is  a  Gaussian 
random  vector  having  zero  mean  and  identity  covariance  matrix  and  5  is  a  non¬ 
negative  random  variable.  Hence, 

Y  =  AZ5-i-b.  (2.18) 

Conditioned  on  S,  the  PDF  of  Y  is  Gaussian,  with  mean  vector  equal  to  b  and 
covariance  matrix  equal  to  AA'^s^.  The  PDF  of  Y  conditioned  on  5  is  given  by 

/Y|s(y|s)  =  (2ir)-^|l;r=»-''eip(-^)  (2.19) 

where  p  =  (y  —  b)^E“^(y  —  b)  and  |S|  denotes  the  determinant  of  the  covariance 
matrix  S  =  AA*^.  Implicit  herein  is  the  assumption  that  S  has  unit  mean  square 
value.  Using  the  theorem  on  total  probability,  the  PDF  of  Y  can  be  written  ss 

/Y(y)  =  (27r)-TlsrU)v(p)  (2.20) 

where 

hsip)  =  ^  s-^^xp{—^)fs{s)ds.  (2.21) 

The  PDF  of  Y  is  of  the  form  of  eq  (2.1).  Therefore,  Y  is  an  SIRV. 
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The  PDF  of  an  SIRV  is  uniquely  determined  by  the  specification  of  a  mean  vector, 
a  covariance  matrix  and  a  first  order  PDF  called  the  characteristic  PDF.  Theorem  1 
for  SSRVs  generalizes  for  SIRVs  in  a  straightforward  meinner.  The  only  difference  is 
that  conditioned  on  the  non-negative  random  variable  T,  the  {1*  :  (A:  =  1,  2,  . . .  N)} 
are  no  longer  statistically  independent.  Instead,  the  PDF  of  Y  conditioned  on  T  is 
a  multivariate  Gaussian  PDF.  By  the  same  ju^gument  used  for  SSRVs,  an  SIRV  can 
be  written  as  a  product  of  a  Gaussian  random  vector  and  a  non-negative  random 
variable.  The  only  difference  is  that  the  mean  of  the  Gaussian  random  vector  need 
not  be  zero  and  its  covariance  matrix  is  not  the  identity  matrix.  As  a  corollary 
of  Theorem  2  [15],  it  can  be  readily  shown  that  every  linear  transformation  on  an 
SIRV  results  in  another  SIRV  having  the  same  characteristic  PDF.  As  a  special  case, 
when  /s(-s)  =  <5(s  —  1)  where  ^(.)  is  the  unit  impulse  function,  k^ip)  =  eip(— |)  and 
the  corresponding  SIRV  PDF  given  by  eq  (2.20)  is  the  multivariate  Gaussian  PDF. 
Therefore,  the  multivariate  Gaussian  PDF  is  a  special  case  of  the  SIRV  PDF. 

The  following  theorem  from  [16]  provides  an  interesting  property  of  SSRVs  when 
represented  in  generalized  spherical  co-ordinates. 

Theorem  3  A  random  vector  X.  =  [Xi . .  SSRV  if  and  only  if  there  exist 

N  random  variables  R  £  (0,  oo),  0  6  (0, 2x)  and  €  (0,  tt),  {k=l,...N  -2)  such 
that  when  the  components  ofX  are  expressed  in  the  generalized  spherical  coordinates 

X\  =  Rcos($i) 

Xk  =  Rcos{^k)  nfri  sin($i)  (1  <  A;  <  iV  -  2) 

(2.22) 

XN.i  =  Rcos{Q)Y[fjf^sm{^i) 

Xn  =  /?sin(0)n!lT^sin($,) 
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then  the  random  variables  R,  0  and  are  mutually  statistically  independent  and 
have  PDFs  of  the  form 

UkM  =  ^^^^sin^-'^-'^{<f>k)[u{(l>k)  -  u{4>k  -  5r)] 

U{d)  =  {2ic)-^[u{d)-u{d-2-K)\ 

where  r(.)  is  the  Eulero  Gamma  function  and  u(.)  is  the  unit  step  function. 

Proof:  Since  the  random  vector  X  is  an  SSRV,  its  PDF  is  of  the  form  of  eq  (2.2) 
with  hp{{p)  being  given  by  eq  (2.16).  The  Jacobian  of  the  transformation  given  by 
eq  (2.22)  is  obtained  in  [26]  as 

J  =  (ii"-’  n"  (2-24) 

Jt=l 

Using  eq  (2.2)  and  eq  (2.24)  and  noting  that  the  joint  PDF  of  R,  0 

and  (fc  =  1, 2, . . .  iV  —  2)  becomes 

/fl.e,*i...*A,_2(’”,  . . .  (f>N-2)  =  — -■-■yy  hpf{r'^)  JJ  sin^~^~'‘{<j)k)  (2.25) 

(27r)  2  k=i 

Since  the  joint  PDF  in  eq  (2.25),  can  be  written  ais  a  product  of  the  marginal  PDFs 
given  in  eq  (2.23),  the  variables  iZ,  0  and  $fc,  are  mutually  statistically  independent 
with  the  prescribed  PDFs  .  In  order  to  prove  the  sufficient  part  of  the  property,  we 
start  with  the  marginal  PDFs  of  R,  0  and  ^k  given  by  eq  (2.23)  and,  under  the 
assumption  of  statistical  independence,  obtain  the  joint  PDF  of  eq  (2.25).  Using  the 
inverse  Jacobian  of  that  given  by  eq  (2.24),  results  in  the  PDF  of  X  being  given  by 
eq  (2.2). 

2.4  Determining  the  PDF  of  an  SIRV 

In  this  section  we  shall  present  schemes  for  determining  the  PDF  of  an  SIRV.  We 
recognize  that  the  PDF  of  an  SIRV  is  uniquely  determined  by  the  specification  of 
a  mean  vector,  a  covariance  matrix  and  a  characteristic  first  order  PDF  and  that 
the  SIRV  PDF  has  the  form  of  eq  (2.20).  Several  techniques  axe  available  in  the 
literature  for  specifying  hjv(p).  The  simplest  technique  is  to  use  eq  (2.21).  However, 
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this  procedure  requires  the  knowledge  of  the  characteristic  PDF  fs{s).  Therefore, 
when  fs{s)  is  not  known  in  closed  form  or  it  is  difficult  to  evaluate  the  integral  in 
eq  (2.21),  alternate  methods  for  specifying  hN{p)  must  be  examined. 

To  study  the  behavior  of  ^n(p),  it  is  convenient  to  replace  p,  which  is  a  quadratic 
form  depending  on  N,  by  the  dummy  scalar  variable  q.  We  then  write 


f^N{q)  =  ^  s-^exp{—^)fsis)ds. 


(2.26) 


When  both  sides  of  eq  (2.26)  are  differentiated  with  respect  to  q,  we  obtain 


dhsiq) 

dq 


_ 

“  ~2Jo 


iexp{—^)fs{s)ds. 


(2.27) 


The  right  hand  side  of  eq  (2.27)  is  related  to  htf+2iq)  by  the  factor  of  — Thus,  we 
have  an  interesting  result  pointed  out  in  [19]  that 


hN+2{q)  =  (-2) 


dhN{q) 


(2.28) 


Because 


/Y(y)  =  (27r)  ^|S|  hM+2ip) 


(2.29) 


when  Y  is  of  dimension  iV  +  2,  it  follows  that  h!\f{q)  must  be  a  monotonically  decreas¬ 
ing  function  for  all  N.  Eq  (2.28)  provides  a  mechanism  for  relating  higher  order  PDFs 
with  those  of  lower  order,  for  a  given  SIRV.  More  precisely,  starting  with  N  =  I  and 
iV  =  2,  and  using  eq  (2.28)  repeatedly,  gives  the  following  pair  of  recurrence  relations. 


(2.30) 


Therefore,  starting  from  hi{q)  and  ^2(9)  all  PDFs  of  odd  and  even  order  respectively, 
can  be  generated  by  the  use  of  eq  (2.30).  However,  since  hN{.)  is  defined  to  be  a  non¬ 
negative  monotonically  decreasing  function  for  all  N,  hi{.)  and  /i2(-)  must  belong  to  a 
class  of  functions  that  are  non-negative  and  monotonically  decreasing.  Consequently, 
their  successive  derivatives  will  alternate  between  negative  and  positive  functions  that 
are  monotonically  increasing  and  decreasing,  respectively.  Given  hi\f{q),  the  order 
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SIRV  PDF  is  given  by 


(2.31) 


/Y(y)  =  (2>r)-?|SrUA,(p) 

where  hN{p)  is  nothing  more  than  h^iq)  with  q  replaced  by  p. 

Another  approach  for  specifying  hsip)  that  begins  with  the  univariate  character¬ 
istic  function  hats  been  proposed  in  [27,  15,  16].  It  is  required  that  the  univariate 
characteristic  function  be  a  real  even  function  whose  magnitude  is  integrable.  Also,  it 
is  assumed  that  the  components  of  the  SIRV  are  identically  distributed.  Under  these 
conditions,  it  has  been  shown  that 

hffip)  =  r (2.32) 

Jo  * 

where  is  the  univariate  characteristic  function  and  Ja{q)  is  the  Bessel  function 
of  order  a.  Eq  (2.32)  has  an  elegant  proof  by  induction  which  is  presented  here. 
From  eq  (2.20)  it  follows  that  hi(p)  is  related  to  the  first  order  SIRV  PDF  of  the 
component.  More  explicitly,  we  can  write 

fr.M  =  (V^cr)-%(K)  (t  =  1,  2,  . . .  W)  (2.33) 


2 

where  p,-  =  ^  and  cr^  is  the  common  variance  of  the  random  variables  Vi  (t  = 
1,2,...  N).  For  convenience,  assume  that  is  unity.  The  univariate  characteristic 
function  is  then  given  by 

/oo 

fY.{yi)exp{jujyi)dyi  (2.34) 

-OO 

Using  the  inverse  Fourier  transform  and  noting  that  y,  =  hi{pi)  can  be  expressed 
in  terms  of  the  characteristic  function  as 


hi{Pi)  =  /  <j>i(^)exp{-jujy/^(L>.  (2.35) 

v2jr  J-co 

Since  is  the  same  for  all  t,  the  subscript  i  in  eq  (2.35)  can  be  dropped.  In 

addition,  because  (^(w)  is  an  even  function,  we  can  rewrite  eq  (2.35)  as 
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Recognizing  that  cos{x)  =  and  replacing  p  by  the  dummy  variable  q,  we 

have 

^1(9)  =  (-\/?)*  /  u;^(u>)J_i(u;^cb.  (2.37) 

Jo  2 

Since  the  derivation  makes  use  of  eq  (2.28)  it  is  necessary  to  consider  odd  and  even 
values  of  N  separately.  For  odd  values  of  N,  eq  (2.32)  can  be  written  as 


^2N-i(9)  =  (-y/?)*"^  u;^“^(a;)Jis^(u;v^)du;  (2.38) 

Equation  (2.38)  is  now  shown  to  hold  for  all  N  by  means  of  induction.  With  N  —  I, 
eq  (2.38)  reduces  to  eq  (2.37).  It  remains  to  show  that  eq  (2.38)  is  valid  when  N  is 
replaced  by  N  +  1,  Differentiating  both  sides  of  eq  (2.38)  with  respect  to  q,  we  obtain 

First,  focus  on  the  term  2W-3  fcjy^)].  Since  this  involves  the  derivative 

of  a  product,  we  can  write 


Using  the  identity  [28] 


we  have 


(2.40) 


dJa{iq)  ^  T  /  \  T  /  \ 

=  -JM  -  Jo+iiv) 


(2.41) 


=  ^(V?)  (2.42) 

Substituting  eq  (2.42)  in  eq  (2.40)  gives 

(2.43) 

Consequently,  eq  (2.39)  reduces  to 

a;^'''»<^(a;)J2A^(a>\/^dd;.  (2.44) 

However,  from  eq  (2.28)  we  know  that  /i2iv+i(9)  =  (-2)-^^^*^^^.  Hence,  we  have 
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from  eq  (2.44) 


^2iv+i(9)  =  /  uj^'^^<t>{u)j2ti=\{u)y/q)djj.  (2.45) 

JQ  * 

Because  eq  (2.45)  is  identical  to  eq  (2.38)  with  N  replaced  by  A^+1,  it  has  been  shown 
by  induction  that  eq  (2.38)  is  valid  for  all  N.  For  ease  of  derivation,  it  was  assumed 
that  the  components  of  Y  have  identical  variances.  However,  since  the  functional 
form  of  hs{p)  is  invau-iant  to  the  choice  of  p,  it  follows  that  eq  (2.32)is  valid  for  all 
odd  vcilues  of  N. 

In  a  similar  manner,  starting  with  h^ip),  it  can  be  shown  that 

^2N+2(p)  =  f  (2.46) 

Jo 

for  all  N.  Note  that  eq  (2.46)  is  identical  to  eq  (2.32)  with  N  replaced  by  2N  +  2. 
The  proof  of  this  result  is  presented  in  Chapter  3.  Thus,  in  general,  for  any  N  (odd 
or  even),  we  can  write  hN{p)  as  in  eq  (2.32). 

2.5  Properties  of  SIRVs 

In  this  section  we  present  certain  important  properties  of  SIRVs. 

2.5.1  PDF  Characterization 

The  multivariate  PDF  of  an  SIRV  as  given  by  eqs.  (2.20)  and  (2.21)  is  uniquely 
determined  by  the  specification  of  a  mean  vector  b,  a  covariance  matrix  S  and  a 
characteristic  first  order  PDF  /s(s).  It  is  a  non-negative,  real  valued  monotonically 
decreasing  function,  /i;v(.),  of  a  non-negative  quadratic  form  multiplied  by  a  constant. 
The  type  of  SIRV  is  determined  by  the  form  of  /ia^(.)  or,  equivalently,  the  choice  of 
/5(s).  Higher  order  PDFs  can  be  obtained  by  the  use  of  eq  (2.32)  whereas  lower 
order  PDFs  can  be  obtained  in  the  usual  manner  by  integrating  out  the  unwanted 
variables.  We  discuss  this  procedure  in  Appendix  A.  The  PDFs  of  all  orders  axe  of 

the  same  type.  The  marginal  PDFs  are  used  to  classify  the  type  of  SIRV. 

2.5.2  Closure  Under  Linear  Transformation 

As  shown  in  Theorem  2  of  Section  2.3,  every  linear  transformation  of  the  form  of 
eq  (2.17)  on  an  SIRV  results  in  another  SIRV  having  the  same  characteristic  PDF. 
This  feature  is  Ccilled  the  closure  property  of  SIRVs  [15, 16]. 
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2.5.3  Minimum  Mean  Square  Error  Estimation 

In  minimum  mean  square  error  estimation  (MMSE)  problems,  given  a  set  of  data, 
SIRVs  are  found  to  result  in  linear  estimators  [27,  15,  29].  An  interesting  proof  of 
this  property  is  presented  here.  Let  Y  =  [Yi^  Ya^]^  where  Yi  =  \Y\,  . .  .Kn]^ 

and  Y2  =  [VJn+i>  Ym■^2^  •  •  •  Ys]^  denote  the  partitions  of  Y.  It  has  been  pointed  out 
in  [30]  that  the  minimum  mean  square  error  estimate  of  the  random  vector  Y2  given 
the  observations  from  the  rzmdom  vector  Yi,  is  given  by 

Y2  =  E[Y2|Yi]  (2.47) 

where  £'[Y2|Yi]  denotes  the  conditional  mean  or  the  expected  value  of  Y2  given  Yi. 
Assume  that  Y  is  an  SIRV  of  dimension  N  with  characteristic  PDF  fs{s).  Also,  for 
convenience,  it  is  assumed  that  the  mean  of  Y  is  zero.  The  covariance  matrix  of  Y 
denoted  by  S  can  be  partitioned  as 

Cii  C12 

S  =  (2.48) 

C21  C22 

where  Cn  denotes  the  covariance  matrix  of  Yi,  C12  denotes  the  cross  covariance 
matrix  of  the  vectors  Yi  and  Y2,  C2i  is  the  transpose  of  C12,  and  C22  denotes  the 
covariance  matrix  of  the  vector  Y2.  The  PDF  of  Y2  given  Yi  is  expressed  as 

/Y,iYi(y2|yi)  =  (2-49) 

Reccill  from  eqs.  (2.20)  and  (2.21)  that 

/Y(y)  =  (2ir)-f|E|-U„(p)  (2.50) 

where 

hN{p)  =  s~’^exp{-~)fs{s)ds  (2.51) 


16 


and  p  =  y^S“  V-  Note  that  the  inverse  covariance  matrix  can  be  partitioned  as  [26] 


= 


A  B 


C  D 


where 


A  =  (Cii  -  Ci2C22C2i)~^ 
B  =  -ACuC^i 
C  =  -DC2iCiJ 
D  =  (C22-C2lCrJCi2)-^ 


Expanding  the  quadratic  form,  we  have 


(2.52) 


(2.53) 


P  =  Yi  Ayi  +  yf By2  +  yj Cyi  +  yj Dy2. 


(2.54) 


Adding  and  subtracting  yi'Ciiyi  to  the  right  hand  side  of  eq  (2.54)  gives 


P  ~  Yi  (A  —  Cji  )yi  +  Yi'C^iyi  +  Yf^Yz  +  Y^Cyi  +  y^^Yz- 


(2.55) 


Note  that 


Hence, 


A-cr,'  =  -BC2iCrJ. 


(2.56) 


P  =  yfCuVl  -  y,  BCjiCjJyi  +  yfByj  +  yJCyi  +  yjDyj. 


(2.57) 


However,  it  can  be  shown  that 


Y2  Cyi  =  -Y2  DC2iCiiVi 
Yi  By2  =  -Y?Ci^Ci2Dy2 
■Y?BC2iCi2yi  =  yJCji  Ci2DC2iCjj  yi 


(2.58) 
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Making  these  substitutions  in  the  expression  for  p,  it  follows  that 

P  =  yf  Ci^yi+yjDy2-y2  DC2iCiiyi-yf  Cj^Ci2Dy2+yi'Ci^Ci2DC2iCiiyi. 

(2.59) 

This  can  be  rewritten  as 

P  =  yf  criyi  +  (y2  -  C2iCiJyi)^D(y2  -  C2iCiiyi)  (2.60) 
For  simplicity,  we  define 


Pi  =  y?CiJyi 

P2  =  (y2  -  C2iCiJyi)^D(y2  -  C2iCiiVi)- 


(2.61) 


Then, 


P  =  Pi  +P2. 


(2.62) 


From  eqs  (2.62)  and  (2.49)-(2.51),  we  have 


/Y2|Yi(y2|yi)  =  f^~^l  ^■^ea:p(-^i^)/s(5)(is.  (2.63) 


where  k  =  (2x)  2  |S|  2.  Next,  consider 


Noting  that 


j(.  y2e^P(-§My2  =  (2ir)^|D|-h''-”[C2iCrJyil,  (2.65) 


gives 


where  ki  =  (2n‘)“?|Sl~5|D|~2  [C2iCijyi].  When  a  matrix  is  partitioned  as  in 
eq  (2.52),  it  is  known  that  [31] 


m  ,  I  _  1 


|Sl  =  lCii|lC22-C2lCrJCi2l. 


(2.67) 
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Since 


D  =  iC22-C2iCliCi2)-\ 

(2.68) 

it  follows  that 

|S|  =  |C„11D-'| 

(2.69) 

Thus, 

IS-^I  =  |Cn|-‘|D|. 

(2.70) 

Hence,  ki 

=  (27r)“^lCn|"^[C2iCiiyi].  Finally,  since 

/Yi(yi)  =  (2x)-f  IClira  jf  s-"^exp{—^)fs{s)ds. 

(2.71) 

%  =  E[Y2|Yi]  =  [C2iCiiyi] 

(2.72) 

It  is  seen  that  the  MMSE  estimate  of  Y2  given  the  data  Yi  is  a  linear  function  of 

Yi. 

If  the  random  vectors  Yi  and  Y2  have  non-zero  means  denoted  by  bi  and  b2 
respectively,  then  eq  (2.72)  takes  the  form 

£(Y2iY,]  =  b,  +  CjiCrf (yi  -  b,).  (2.73) 

As  a  consequence  of  this  property,  when  the  random  vectors  Yi  and  Y2  are  un¬ 
correlated  so  that  C21  =  0,  then  we  have 

i^(Y2|Yi]  =  b2  =  i;[Y2].  (2.74) 

This  property  is  referred  to  as  semi  independence  in  [27,  32,  15).  However,  for  all 
SIRVs  except  the  Gaussian,  this  result  does  not  imply  that 

/Y2iYi(y2lyi)  =  /YgCyz) 

This  emphasizes  the  property  that  although  uncorrelatedness  guarantees  statistical 

independence  for  Gaussian  random  vectors,  it  is  not  a  general  property  of  SIRVs. 
2.5.4  Distribution  Of  Sums  of  SIRVs 

While  it  is  true  that  the  sum  of  two  jointly  Gaussian  random  vectors  is  also  Gaus¬ 
sian,  the  same  is  not  true  for  SIRVs  in  general.  This  result  holds  for  two  SIRVs,  when 
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they  axe  statistically  independent,  having  zero  mean  and  when  the  covariance  matrix 
of  the  first  is  within  a  multiplicative  constant  of  the  covariance  matrix  of  the  second 
[15,  16].  More  precisely,  let  Yi  =  [lii.  Vis,  and  3^  =  ^22, 

denote  two  independent  zero  mean  SIRVs.  The  covariance  matrix  and  characteristic 
PDF  of  Yi  are  denoted  by  Si  and  fsi{si).  The  corresponding  quantities  for  Y2  are 
denoted  by  S2  and  f 32(^2)’  We  axe  interested  in  obtaining  the  distribution  of  the 
sum  given  by 

Y  =  Yi+Y2.  (2.76) 

The  characteristic  function  of  Y  is  given  by 

F;[eip(;u;^Y)]  =  pi(u;'rSiu;)p2(w^S2a;)  (2.77) 

where  gi{.)  and  g2{.)  are  the  characteristic  functions  of  Yi  and  Y2,  respectively.  If 
Y  is  a  zero  mean  SIRV,  then  its  characteristic  function  heis  the  form 

E[exp{j(J^Y)]  =  g^u/^Hu).  (2.78) 

In  order  to  write  eq  (2.77)  as  a  function  of  a  single  quadratic  form,  S2  must  be  within 

a  multiplicative  constant  of  Si. 

2.5.5  Markov  Property  for  SIRPs 

An  interesting  property  of  SIRPs  is  that  a  zero  mean  wide  sense  stationary  SIRP 
is  Markov  if  and  only  if  its  autocorrelation  function  has  the  form 

il(ti,  fi)  =  exp{-a\{ti  —  <2!)  (2.79) 

This  result  is  well  known  for  the  special  case  of  a  zero  mean  wide  sense  stationary 
Gaussian  random  process.  To  demonstrate  the  more  general  result  we  consider  N 
samples  from  a  zero  mean  wide  sense  stationary  SIRP  y{t).  Let  Y  =  [Vi,  12  •  •  •  >  YnY 
denote  the  vector  of  successive  samples  obtained  from  the  SIRP. 

Given  that  y{t)  is  a  zero  mean  wide  sense  stationary  Markov  SIRP,  we  first  show 
that  its  autocorrelation  function  must  have  the  form  of  eq  (2.79). Let  Fi,  F2  and  I3 
denote  the  random  vaxiables  obtained  by  sampling  y(t)  at  time  instants  ii,  <2  and  <3 
such  that  ti  <  t2  <  <3.  Since  y{t)  is  a  Markov  process,  the  joint  PDF  of  ii,  I2  and 
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>3  can  be  expressed  as 


fYuY2,Y3iyuy2,yz)  =  /n(yi)/y2iyi(y2|yi)/y3iv2(y3ly2)- 


(2.80) 


The  autocorrelation  function  R{tz,ti)  =  .£[131^1]  is  given  by 


Rih,^)  =  f  f  f  yzy\fYx,Yi,Yi{y\-,y2^yz)dy\dy2dyz.  (2.81) 

J  ^00  J  —00  •/  — 00 


Also, 


Hence, 


!Hh,U)  =  E[Y^]  =  r 

J^oo 


(2.82) 


R{t3,ti)R{t2,t2)=  I  III  yzyifYuY2,Yi{yuy2,y3)dyidy2dy3ylfY^{y2)dy2. 

(2.83) 

Using  eq  (2.80)  we  can  rewrite  the  above  equation  as 

R{t3,ti)R{t2,t2)  -  I  I  yzy2fYi,Yi{y3,y2)dy3dy2 1  /  y2yifY2,Yi{y2,yi)dy2dyv 

00  00  »/— 00  J —00 

(2.84) 


Consequently, 


.R(t3?tl)-ft(^2)^2)  —  R{^Zi't2)R{^2i't\) 


(2.85) 


The  only  non-triviai  autocorrelation  function  satisfying  this  property  is  given  by 
eq  (2.79). 

Since  y{t)  is  a  zero  mean  SIRP,  it  follows  that  .£'[Y]  =  0.  Letting  h  =  exp(—a),  we 
can  write  the  covariance  matrix  of  Y  as 


1  b 


b  1  ...  6^-2 

S=  b  ...  6^-3 


(2.86) 


6^-^  6^-2  ...  1 


under  the  assumption  that  ti,  •  •  • »  =  U  2, . . . ,  iV.  We  then  malce  use  of  eq  (2.73) 
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to  obtain 


E[Ys\Ym-i,  Yr,.2  . . . ,  Ki]  =  . . .  6]Syr^Y' 

where  Y'  =  [Yi,  Yj,  •  •  • ,  Y;v-i]^  and 


(2.87) 


Sy'  = 


1  b 


b  1  ...  6^-3 


(2.88) 


Recognizing  that 


JjN-2  IjN-3  _  1 


1  -b  0.., 


-6  1  +  62  -6  0 


_j  1  0-6  1  +  62  ..... .  0 


1-62 


(2.89) 


0  .., 


—6  1  +  62  —6 


-6  1 


Therefore,  we  can  rewrite  eq  (2.87)  as 


£’[Y;v|Ya^_1,  Yn-2  .  .  . ,  Yi]  =  6Ya^_i. 


From  eq  (2.73),  we  also  obtain 


(2.90) 


F?[Y;v|Y^-l]  =  6YAr_i. 


(2.91) 


Clearly  £'[YAr|Yv-i]  —  £'[Y;v|Y;v-i,  Yn-2  ...,Yi].  Since  this  must  be  true  for  all 
choices  of  Yi,  Y2,  ...,  Y/v_i,  it  follows  that  /y^r|yw_,,yw_j...,yj(yiv|yiv-i,  yN-2  .-MyO  = 
fyiflvN-iiVNlyN-i)-  Hence,  y{t)  is  Markov. 
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2.5.6  Kalman  Filter  for  SIRPs 

It  has  been  shown  by  Chu  in  [29]  that  the  Kalman  filter  for  SIRPs  is  identical  to 
the  corresponding  filter  for  a  Gaussiain  random  process.  The  model  considered  in  [29] 
is  given  by 


—  FjjXic  +  Gk^k  (fc  —  0,  1,  . . . ,  iV  1) 
yk  =  HkXk  +  Vk  (fc  =  0,  1, . . . ,  iV  -  1) 


(2.92) 


where  Xk  denotes  the  state  vector  of  the  underlying  process,  Wk  is  its  excitation 
vector,  yk  denotes  the  observation  vector  and  Vk  is  the  measurement  noise.  It  is 
assumed  that  Xk,  Wk  and  Vk  are  jointly  SIRP  with  a  common  characteristic  PDF 
fs{s).  Also,  let 


jE;[xk]  =  Xk  (fc  =  0,  1,  . . . ,  AT  -  1) 

^[(xk  -  5^)(xk  -  Xk)^]  =  Mk 
£;[wk]  =  i:[vk]  =  0 

^[(xk  -  5^)wk^]  =  F[(xk  -  3Ck)vk^]  =  F[wkV J]  =  0 


(2.93) 


^[WklWkm]  =  Qkkm 
■F[vklVkm]  “ 

where  Wkm  and  Vkm  are  the  components  of  Wk  and  Vk  respectively,  and  6i,m  is 
the  Kronecker  delta  function.  Hence,  Xk,  Wk  and  Vk  are  mutually  uncorrelated  while 
Wk  and  Vk  are  each  white  with  zero  mean. 

The  innovations  vectors  is  defined  as 


yk|k-i  =  yk  -  HkXk|k-i  (2.94) 

where  Xk|k-i  is  the  MMSE  estimate  of  Xk  given  the  observation  vectors  up  to  A:  —  1. 
The  covariance  matrix  of  the  innovations  can  be  shown  to  be 

Cou(5'’k|k-l)  —  Sk|k-1  =  (HkMkHk  +  R-k)*  (2.95) 

It  can  be  readily  shown  that  Xk  and  yk  are  jointly  SIRP.  Therefore,  the  MMSE 
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estimate  of  Xk  given  the  observation  vectors  up  to  A:  —  1  is  a  lineau^  function  of  ym 
m  =s  1,  2,  . . . ,  A:  —  1,  as  shown  by  eq  (2.73).  Hence,  the  Kalman  filter  equations  for 
SIRPs  are  identical  to  those  for  the  Gaussian  case.  The  Kalman  gain  denoted  by 


Kk|k  is  expressed  as 

Kkik  =  MkHfSj^.,.  (2.96) 

The  measurement  update  Xk)k  is  given  by 

Xk|k  =  Xk|k-i  +  Kk|kyk|k-i  =  (I  -  Kk|k)xk|k-i  +  Kkikyfc-  (2.97) 

The  covarieince  matrix  of  the  error  in  the  update  can  be  written  as 

Ck  =  Mk  -  MkHf  (HkMkHf  +  Rk)-'HkMk.  (2.98) 

The  prediction  is  then  given  by 

Xk+i|k  =  FkXkik-  (2.99) 

Finally,  the  covariance  matrix  of  the  prediction  is  expressed  as 

Mk+i  =  FkCkFj  +  GkQkGf  (S-lOO) 


When  systems  driven  by  non-Gaussian  noise  are  encountered  in  practice,  under  the 
assumption  of  joint  SIRP,  these  equations  provide  an  efficient  computation  formula 

for  the  Kalman  filter. 

2.5.7  '  Statistical  Independence 

We  point  out  that  the  only  case  for  which  the  components  of  an  SSRV  are  statis¬ 
tically  independent  occurs  when  the  SSRV  is  Gaussian.  This  property  is  proved  in 
Appendix  A. 

2.5.8  Ergodicity  of  SIRPs 

It  has  been  pointed  out  in  [27]  that  an  ergodic  SIRP  is  necessarily  Gaussian.  The 
proof  of  the  non-ergodicity  of  SIRPs  (except  Gaussian)  can  be  easily  obtained  using 
the  representation  theorem  [15]  for  SIRPs  which  states  that  an  SIRP  is  a  univariate 
randomization  of  the  Gaussian  random  process.  More  precisely,  if  y{t)  is  an  SIRP, 
then  it  can  be  expressed  as  y{t)  =  5z(t),  where  5  is  a  non-negative  random  variable 
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and  z{t)  is  a  Gaussian  random  process.  Clearly,  if  z{t)  is  stationary,  then  y{t)  will 
also  be  stationary.  However,  different  realizations  of  S  result  in  different  scale  factors 
for  the  sample  functions  of  y{t).  Therefore,  time  averages  will  differ  from  one  sample 
function  to  emother  and,  in  general,  will  not  equal  the  corresponding  ensemble  average. 
Consequently,  y{t)  cannot  be  ergodic.  When  5  is  a  non-random  constant,  y{t)  is  a 
Gaussian  random  process.  Then  y(<)  will  be  ergodic  provided  z{t)  is  also  ergodic.  It 
is  concluded  that  only  Gaussian  SIRPs  can  be  ergodic. 

2.6  Conclusion 

In  this  chapter,  we  have  presented  2in  overview  of  the  literature  on  the  modeling  of 
rauiar  clutter  and  the  theory  of  SIRPs.  It  is  clear  from  this  chapter  that  the  PDF  of 
an  SIRV  is  uniquely  determined  by  the  specification  of  a  mean  vector,  a  covariance 
matrix  and  a  characteristic  first  order  PDF.  It  is  also  seen  that  many  interesting 
properties  of  Gaussian  random  processes  extend  readily  to  SIRPs.  A  major  difference 
with  non-Gaussian  SIRPs  is  their  non-ergodic  behavior.  Consequently,  time  averages 
do  not  result  in  corresponding  ensemble  averages.  However,  if  ensemble  averages  are 
used  instead  of  time  averages,  then  non-ergodicity  is  not  a  serious  problem.  In  the 
following  chapters,  we  shcdl  present  the  application  of  SIRPs  for  non-Gaussian  radar 
clutter  modeling,  simulation  and  distribution  identification. 
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Chapter  3 


Radar  Clutter  Modeling  Using 
Spherically  Invariant  Random 
Processes 

3.1  Introduction 

In  this  chapter  we  consider  the  use  of  the  theory  of  spherically  invariant  random 
processes  (SIRP)  for  modeling  correlated  non-Gaussian  radar  clutter.  It  has  been 
pointed  out  in  chapter  2  that  radar  clutter  can  be  non-Gaussian  and  that  radars  pro¬ 
cess  N  pulses  at  a  time.  Furthermore,  the  clutter  can  be  highly  correlated.  Therefore, 
by  clutter  modeling  we  mean  the  specification  of  the  joint  probability  density  func¬ 
tion  (PDF)  of  the  N  correlated  clutter  samples.  Since  we  are  dealing  with  correlated 
clutter,  the  joint  PDF  cannot  be  constructed  by  simply  taking  the  product  of  the 
marginal  PDFs.  This  chapter  presents  a  mathematically  elegant  and  tractable  ap¬ 
proach  for  specifying  the  joint  PDF  of  N  clutter  samples.  In  addition,  we  discuss 
the  characterization  of  Gaussian  and  non-Gaussian  correlated  random  vectors,  the 
need  for  a  library  of  multivariate  PDFs  for  modeling  correlated  non-Gaussian  clut¬ 
ter,  several  techniques  for  establishing  this  library  and,  finally,  a  key  result  for  the 
distribution  identification  of  multivariate  correlated  non-Gaussian  random  vectors. 

Specifically,  the  problem  of  modeling  a  random  vector  obtained  by  sampling  a 
stochastic  process  y{t)  at  N  time  instants  is  of  interest  to  us.  The  stochaistic  process 
may  be  real  or  complex.  In  addition,  there  is  no  restriction  on  the  number  of  samples 
obtained  or  the  sampling  time  instants.  In  order  to  completely  characterize  the 
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random  vector  we  need  to  specify  the  joint  probability  density  function  of  the  N 
samples  (real  or  complex)  or,  equivalently,  specify  the  joint  characteristic  function. 
This  problem  is  very  well  treated  when  the  underlying  stochastic  process  is  Gaussian. 
The  joint  PDF  in  this  case  can  be  written  as  (27r)‘“T|Sl“2exp(— ^),  where  p  is  a 
non- negative  quadratic  form  given  by  p  =  [y  —  —  p].  Here  p  and  S  denote 

the  mean  vector  and  covariance  matrix  of  the  Gaussian  random  vector  Y  whose 
components  are  the  N  samples  of  y{t).  However,  if  y{t)  is  not  a  Gaussian  random 
process,  there  is  no  unique  specification  for  the  joint  PDF  of  the  N  samples  except 
when  the  samples  are  statistically  independent. 

When  processing  real  world  data,  neither  the  Gaussian  nature  of  the  underlying 
stochastic  process  nor  the  statistical  independence  of  the  samples  is  guaranteed.  In 
fact,  it  is  likely  that  the  samples  may  be  correlated.  Hence,  we  need  to  obtain 
multivariate  non-Gaussian  PDFs  which  can  model  the  correlation  between  samples. 
In  practice,  radar  clutter  can  vary  from  one  application  to  another.  Therefore,  we 
need  to  have  available  a  library  of  possible  multivariate  non-Gaussian  PDFs  so  that 
an  appropriate  PDF  can  be  chosen  to  approximate  the  data  for  each  clutter  scenario. 

The  theory  of  Spherically  Invariant  Random  Processes  (SIRP)  provides  us 
with  elegant  and  mathematically  tractable  techniques  to  construct  multivariate  non- 
Gaussian  PDFs.  Spherically  invariant  random  processes  are  generalizations  of  the 
familiar  Gaussian  random  process.  The  PDF  of  every  random  vector  obtained  by 
sampling  a  SIRP  is  uniquely  determined  by  the  specification  of  a  mean  vector,  a 
covariance  matrix  and  a  characteristic  first  order  PDF.  In  addition,  the  PDF  of  a 
random  vector  obtained  by  sampling  a  SIRP  is  a  function  of  a  non-negative  quadratic 
form.  However,  the  PDF  does  not  necessarily  involve  an  exponential  dependence 
on  the  quadratic  form,  as  in  the  Gaussian  case.  Such  a  random  vector  is  called  a 
Spherically  Invariant  Random  Vector  (SIRV). 

There  are  two  kinds  of  models  for  non-Gaussian  radar  clutter.  One  is  called  the 
endogenous  model,  where  the  desired  non-Gaussian  process  with  prescribed  envelope 
PDF  and  correlation  function  is  realized  by  using  a  zero  memory  non-  linear  trans¬ 
formation  on  a  Gaussian  process  having  a  prespecified  correlation  function.  In  this 
approach  it  is  not  possible  to  independently  control  the  envelope  PDF  and  the  cor¬ 
relation  properties  of  the  non-Gaussian  process.  In  addition,  not  all  nonlinearities 
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give  rise  to  a  non-negative  definite  covaxiance  matrix  at  their  outputs  [33,  34].  The 
second  model  is  called  an  exogenous  product  model  [13].  In  this  model,  the  desired 
non-Gaussian  clutter  is  generated  by  the  product  of  a  Gaussian  random  process  and 
an  independent  non-Gaussian  process  which  can  be  highly  correlated.  In  this  scheme, 
the  desired  envelope  PDF  and  the  correlation  properties  can  be  controlled  indepen¬ 
dently.  The  exogenous  model  can  be  thought  of  as  a  slowly  time  variant  non-Gaussian 
process  modulating  a  Gaussian  random  process.  The  SIRP  is  a  special  case  of  the  ex¬ 
ogenous  model,  arising  when  the  modulating  process  does  not  change  rapidly  during 
the  observation  interval  and  can  be  approximated  as  a  random  variable.  This  is  due 
to  the  fact  that  the  representation  theorem  for  SIRPs  allows  us  to  explicitly  write 
the  non-Gaussian  process  as  a  product  of  a  Gaussian  process  and  a  non-negative  ran¬ 
dom  variable.  By  assuming  statistical  independence  between  the  modulating  random 
variable  and  the  Gaussian  process,  it  is  possible  to  independently  control  the  non- 
Gaussian  envelope  PDF  and  its  correlation  properties.  The  SIRP  is  the  only  known 
case  of  the  exogenous  multiplicative  model  which  allows  the  specification  of  the  N^'' 
order  PDF. 

Section  3.2  outlines  the  problem  of  interest.  In  Section  3.3  we  present  several 
techniques  to  obtain  SIRVs.  Examples  based  on  various  techniques  described  in 
Section  3.3  are  used  to  obtain  a  library  of  SIRV  PDFs  in  Section  3.4.  Finally,  in 
Section  3.5,  we  present  a  key  result  which  characterizes  SIRVs  by  using  the  quadratic 
form  appearing  in  their  PDFs. 

3.2  Problem  Statement 

We  assume  we  are  dealing  with  coherent  radar  clutter.  By  coherent  radar  clut¬ 
ter,  we  mean  that  the  clutter  is  processed  in  terms  of  its  in-phase  and  out  -of-phase 
quadrature  components.  Pre-detection  radcir  clutter,  being  a  bandpass  random  pro¬ 
cess,  admits  a  representation  of  the  form 

y{t)  =  Re{y{t)exp{ju>ot)}  (3.1) 

where  y{t)  =  ydt)  +  jysit)  denotes  the  complex  envelope  of  the  clutter  process,  uq 
is  a  known  carrier  frequency,  ydt)  and  y,(t)  denote  the  in-phase  and  out-of-phase 
quadrature  components  of  the  complex  process  y{t).  Equation  (3.1)  can  be  rewritten 
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as 

y{t)  =  ycit)cos{ujot)  -  ys{t)sin{uot).  (3.2) 

We  are  interested  in  specifying  the  joint  PDF  of  N  samples  obtained  by  sampling 
the  process  y{t).  Since  it  is  always  more  convenient  to  work  with  the  associated  low 
pass  process,  we  consider  the  equivalent  problem  of  specifying  the  PDF  of  N  complex 
samples  obtained  from  the  complex  process  y{t).  The  PDF  of  a  complex  random 
vaxiable  is  defined  to  be  the  joint  PDF  of  its  in-phase  and  out-of-phase  quadrature 
components.  Therefore,  it  follows  that  the  joint  PDF  of  N  complex  random  variables 
is  the  joint  PDF  of  the  2N  in-phase  and  out-of-phase  quadrature  components.  While 
dealing  with  complex  random  variables,  it  is  sometimes  more  convenient  to  work 
with  their  envelope  and  phase.  The  envelope  Ri  and  phase  0^  of  a  complex  random 
variable  Y]  =  Yd  +  jYd  are  defined  by 

Ri  = 

0.  = 

We  consider  the  problem  of  specifying  the  PDF  of  a  random  vector  =  [Yc^iYs^]  ob¬ 
tained  by  sampling  the  random  process  where  Yc  =  [Yd?  Y:2»  •■•■,Ycn]^ 

Ys  =  [Y,i,  Yj2»  The  subscripts  c  and  s  denote  the  in  phase  and  out  of 

phase  quadrature  components,  respectively.  We  assume  that  the  process  y{t)  is  a 
wide  sense  stationary  random  process.  The  necessary  and  sufficient  conditions  for 
y{t)  to  be  a  wide  sense  stationary  random  process  [30]  are: 

(A)  The  quadrature  components  have  zero  mean. 

(B)  The  envelope  of  the  pairwise  quadrature  components  is  statisti¬ 
cally  independent  of  the  phase  and  the  phase  is  uniformly  dis¬ 
tributed  over  the  interval  (0, 27r).  This  results  in  the  pair  wise 
quadrature  components  being  identically  distributed  and  their 
joint  PDF  being  circularly  symmetric.  This  also  results  in  the  or¬ 
thogonality  of  the  pairwise  quadrature  components  at  each  sam¬ 
pling  instant. 

(C)  The  autocovariance  function  and  crosscovariance  function  of  the 


2irctan(^). 


(3.3) 
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quadrature  processes  of  the  complex  process  y{t)  =  ydt)  + 
jys{t)  satisfy  the  conditions  given  by 


where 


K^ir)  =  K,,{t) 

K^(t)  =  -K^r) 

K^{t)  =  E{Xcit)X,{t-T)} 
K,,{t)  =  E{X,it)X,it-T)} 
K,,{t)  =  E{Xc{t)Xs{t-T)} 

Ksc{t)  =  E{X,{t)X,{t-T)}. 


(3.4) 


(3.5) 


Any  choice  of  autocovariance  and  crosscovariance  functions  is  allowed  as  long  as 
requirement  (C)  is  satisfied  and  the  resulting  covariance  matrix  of  Y  is  nonnegative 
definite. 

Due  to  requirement  (A),  £'{Yc}  =  £^{Ys}  =  0.  It  follows  that  E(Y}  =0.  As  a 
consequence  of  requirements  (B)  and  (C),  the  covariance  matrix  of  Y,  given  by 


I  Scs 

I  - 
I  Sgs 


must  satisfy  the  conditions: 


Sec  — 


ScB  —  — Sg 


(3.6) 


(3.7) 


with  the  elements  of  the  main  diagonal  of  the  matrices  Scs  and  Sge  being  equal 
to  zero.  Note  that  Sec  =  £^{YcYT},  Scs  =  E{YcY^},  Sgc  =  £{YsY^}  and 
Sgg  =  £?{YsY^}.  Finally,  we  point  out,  regardless  of  the  value  of  N,  we  always 
have  an  even  order  PDF  when  dealing  with  quadrature  components.  We  axe  now  in 
a  position  to  proceed  with  the  characterization  of  Y  as  an  SIRV. 
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For  an  SIRV,  it  is  pointed  out  that  the  PDF  of  a  given  order  automatically  implies 
all  lower  order  PDFs.  For  example,  if  N  random  variables  are  jointly  Gaussian,  it  is 
well  known  that  the  order  PDF,  i  =  1,  2,  . . .  ,iV  -  1  is  Gaussian.  This  property 
of  SIRVs  is  called  internal  consistency.  The  requirements  (A)-{C)  arising  from  the 
wide  sense  stationarity  requirements  of  the  process  y{t)  are  called  external  consistency 
conditions.  Requirements  (A)-(C)  are  not  inherent  to  the  SIRP  and  do  not  hold  when 
the  SIRP  is  not  wide  sense  stationary. 

3.3  Techniques  for  Determining  the  SIRV  PDF 

In  this  section,  several  techniques  are  presented  for  obtaining  A2n(p)*  For  con¬ 
venience,  temporal  wide  sense  stationarity  of  the  underlying  bandpass  process  is 
aissumed.  However,  the  functional  form  of  /i2n(*)  is  unaffected  whether  or  not  the 
random  process  is  temporally  wide  sense  stationary.  Hence,  it  is  allowable  to  let 
p  =  (y  —  (y  —  b)  in  the  finail  result,  in  general,  where  b  is  any  mean  non-zero 

vector  and  S  is  any  non-negative  definite  matrix. 

Recall  from  Chapter  2  that  the  PDF  of  an  SIRV  =  [Yc^:Y9^]  with  Yc  and  Ys 
defined  in  Section  3.2  is  given  by 

/Y(y)  =  (2<r)-''|S|-Uw(p)  (3.8) 

Assuming  temporal  wide  sense  stationarity,  p  =  y^S“^y  where  E  is  given  by  eq  (3.6). 
The  mean  vector  of  Y  is  zero  due  to  requirement  (A)  in  Section  3.2.  The  covariance 
matrix  S  having  the  form  of  eq  (3.6)  and  satisfying  the  requirements  of  eq  (3.7) 
is  readily  determined  when  the  autocorrelation  function  of  the  process  is  specified. 
Given  E,  several  techniques  for  obtaining  A2n(p)  are  presented  in  this  section. 

The  representation  theorem  for  SIRVs  allows  us  to  express  Y  as  a,  product  of  a 
Gaussian  random  vector  Z,  having  the  same  dimensions  as  Y  and  a  non- negative 
random  variable  S.  For  the  problem  of  radar  clutter  modeling,  since  it  is  desirable  to 
control  the  non-Gaussian  nature  of  Y  and  its  correlation  properties  independently, 
we  assume  that  the  random  variable  S  is  statistically  independent  of  Z.  In  addition, 
the  covariance  matrix  of  the  SIRV  can  be  made  equal  to  the  covariance  matrix  of  the 
Gaussian  rzindom  vector  by  requiring  E{S^)  to  be  unity.  Finally,  it  is  pointed  out 
that  the  mean  of  Z  is  necessarily  zero. 
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A  physical  interpretation  can  be  given  to  Z  and  S.  Consider  a  surveillance  volume 
subdivided  into  contiguous  range-Doppler-aaimuth  cells.  Assuming  a  large  enough 
cell  size  such  that  many  scatterers  are  located  in  each  cell,  the  N  pulse  returns  from  a 
given  ceil  can  be  modeled  as  the  Gaussiein  vector  Z  due  to  the  central  limit  theorem. 
Also  assume  that  the  average  clutter  power  remains  constant  over  the  N  pulse  returns 
in  a  coherent  processing  interval.  However,  the  average  clutter  power  is  allowed  to 
vary  independently  from  cell  to  cell  since  different  sets  of  scatterers  are  located  in 
each  cell.  The  variation  of  the  average  clutter  power  from  cell  to  cell  is  modeled  by 

the  square  of  the  non-negative  random  vziriable  5. 

3.3.1  SIRVs  with  Known  Characteristic  PDF 

We  consider  specification  of  the  PDF  of  the  SIRV  Y  when  its  characteristic  PDF 
is  known  in  closed  form.  We  have  pointed  out  in  the  previous  section  that  the  mean 
vector  of  Y  is  zero.  Also,  we  have  discussed  the  specification  of  the  covariance  matrix 
of  Y.  Now,  we  shall  focus  on  the  specification  of  /i2A/(p).  As  a  consequence  of  the 
representation  theorem,  we  can  write 

hMp)  =  5"^^exp(-^)/s{s)ds.  (3.9) 

Equation  (3.9)  enables  us  to  specify  h2N{p)  when  the  characteristic  PDF  fs{$)  is 
known  in  closed  form.  However,  in  some  cases,  even  though  an  analytical  expression 
is  known  for  the  characteristic  PDF,  it  may  be  difficult  to  evaluate  the  integral  in 
eq  (3.9)  in  closed  form.  In  such  instances,  an  alternate  method  for  specifying  h2N{p) 

must  be  examined.  The  method  presented  in  the  next  section  is  useful  for  these  cases. 

3.3.2  SIRVs  with  Unknown  Characteristic  PDFs 

When  the  characteristic  PDF  of  the  SIRV  is  unknown  or  when  the  integral  in 
eq  (3.9)  is  difficult  to  evaluate,  we  propose  an  alternate  method  to  obtain  h2N{p). 
Recall  that  we  are  deeding  with  an  even  order  PDF.  Therefore,  we  can  use  eq  (2.30) 
starting  with  ^2(9)  to  obtain  h2N{<l)-  It  is  worthwhile  pointing  out  that  h2{.)  is  related 
to  the  first  order  envelope  PDF.  From  requirement  (B)  of  Section  3.2,  the  joint  PDF 
of  the  in  phase  and  out  of  phase  quadrature  components  can  be  expressed  as 

fYci,Y.i{ycii  y»i)  =  (2’r)"V~^ft2(p)  (i  =  1,  2,  . . . ,  N)  (3.10) 


32 


where  p  =  and  denotes  the  common  variance  of  the  in  pha^e  and  out 

of  phase  quadrature  components.  The  envelope  and  phase  corresponding  to  the  i** 
quadrature  components  is  given  by 


(3.11) 


Due  to  the  assumption  of  wide  sense  stationarity,  we  can  drop  the  subscript  i  in 
eq  (3.11).  The  Jacobian  of  the  transformation  given  by  eq  (3.11)  is  J  =  where 
J  denotes  the  Jacobian.  Using  the  Jacobian  in  eq  (3.10)  results  in  the  joint  PDF  of 


R  and  0  being  given  by 


/R.e(r,  e)  = 


(3.12) 


Clearly,  the  joint  PDF  in  eq  (3.12)  can  be  factored  as  a  product  of  the  marginal  PDFs 
of  the  random  variables  R  and  0.  Consequently,  the  random  variables  R  and  0  are 
statistically  independent  with  PDFs  given  by 


fR{f)  =  (0  <  r  <  oo) 

feiO)  =  (27r)-i  (O<0<2t). 


(3.13) 


Equation  (3.13)  relates  the  envelope  PDF  to  h2{.).  Hence,  we  can  write 

=  tM’-)-  (3-14) 

<T  r 

Thus,  eq  (3.14)  provides  a  mechanism  to  obtain  h2{q).  Starting  from  h2{q),  we  then 
use  eq  (2.30)  to  obtain  h2i\r{q).  Since  not  ail  non-Gaussian  envelope  PDFs  are  ad¬ 
missible  for  characterization  as  SIRVs,  we  must  check  that  ^2(9)  its  derivatives 
satisfy  the  monotonicity  conditions  stated  in  Chapter  2.  Finally,  /i2n(p)  is  obtained 

by  simply  replacing  g  by  p  =  (y  -  b)^S“’(y  -  b)  in  h2N{q). 

3.3.3  Hankel  Transform  Approach 

In  this  section  we  present  an  approach  based  on  the  Hankel  transform  for  specifying 
^2/v(p)'  Recall  that  the  joint  PDF  of  the  in-phase  and  out-of-phase  quadrature 
components  of  Y  is  given  by  eq  (3.10).  For  convenience,  it  is  assumed  that  <t^  is 
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unity.  Dropping  the  subscript  i  from  eq  (3.10),  the  joint  characteristic  function  of  Yd 
and  Yd  is  expressed  eis 

<^2)  =  (27r)"^  I  f  exp{ju}iyc  + ji^2ys)h2{yl  +  y])dycdys-  (3.15) 

y— 00  00 

Introducing  the  transformations 


ajctan  ^ 


=  VU?1+W2 


(3.16) 


arctan  ^ 

Ul 


we  can  rewrite  eq  (3.15)  as 


<^y  y,(a;i,  a;2)  =  (27r)  ^  f  f  exp[jujr{cos{0)cos{a)  +  sin{0)sin{a)}]rh2{r'^)dr  dd. 

*  Jo  Jo 

(3.17) 

Noting  that  cos{A  -  B)  =  cos{A)cos{B)  +  sm(A)sm(J5),  we  can  rewrite  eq  (3.17)  as 

<^y^,y,(cJi,  0(2)  =  (27r)“^  /  /  ea:p[;a;rcos(0  -  Q:)]r/i2(r^)drd0.  (3.18) 

Jo  Jo 


Interchanging  the  order  of  integration  in  eq  (3.18),  and  recognizing  that  [35] 


1 

M^)  =  T"  /  exp[jxcos{0  -  'r)]dl3, 
2ir  Jo 


(3.19) 


where  Jo(x)  is  the  Bessel  function  of  order  zero,  we  have 


roo 

dfYc.Y.i^^i,  W2)  =  /  rh2{r^)Jo{ojr)dr. 
Jo 


(3.20) 


From  eq  (3.20),  it  is  clear  that  the  joint  characteristic  function  of  Yc  and  V",  is  a 
function  of  w  =  yjoul  d-Wj.  Hence,  it  is  a  circularly  symmetric  characteristic  function. 
Denoting  this  function  by  'F(u’),  we  can  write 


roo 

^(u>)  =  /  r/i2(r^)Jo(wr)dr. 
Jo 


(3.21) 
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Equation  (3.21)  is  recognized  as  the  Hankel  transform  of  order  zero  of  h2{r^).  Using 
the  inverse  Hankel  transform,  we  obtain 


h2{r^)  =  f  u}^  {u))Jo{u}r)du}.  (3.22) 

Jo 

Introducing  the  dummy  vciriable  w,  we  can  write 

^2(9)  =  /  u}'^{u))Jo(u)y/^dw.  (3.23) 

We  then  use  eq  (2.30)  to  obtain  ^2^(9)*  More  explicitly,  we  can  write 

/.„(,)  =  (-a)"-' jf  (3.24) 

Using  the  identity  [35] 

=  -Ml)  (3-25) 

we  have 

d./o(W-y/9)  ^  J  (  I — ^  fry 

- dq  —  = 

Use  of  the  recurrence  relation  [35] 

(3.27) 

results  in 

(3-28) 

Repeated  use  of  eq  (3.27)  gives 

J/V-I  N-l 

=  (3.29) 

Substituting  eq  (3.29)  in  eq  (3.24)  gives 

h2N{q)  =  {y/qy-^  r (3.30) 
Jo 

Finally,  h2N{p)  is  obtained  from  eq  (3.30)  by  replacing  9  by  p  =  (y  —  h)^S“^(y  —  b). 
This  completes  the  proof  of  eq  (2.32)  for  even  values  of  N  which  had  been  previously 
deferred.  The  integral  in  eq  (3.30)  is  recognized  as  the  Hankel  transform  of  order 
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^  —  1  of  A  number  of  Hankel  transforms  have  been  provided  in  [36]  and  these 

will  be  made  use  of  in  the  examples  presented  in  Section  3.4. 

3.4  Examples  of  Complex  SIRVs 

This  section  presents  examples  based  on  the  approaches  discussed  in  Section  3.3 
and  is  divided  into  three  parts.  In  section  3.4.1,  we  present  examples  that  assume 
the  knowledge  of  the  characteristic  PDF.  In  Section  3.4.2,  the  marginal  envelope 
PDF  is  assumed  to  be  known  whereas  in  Section  3.4.3,  knowledge  of  the  marginal 
characteristic  function  is  assumed.  Finally,  at  the  end  of  Section  3.4.3  we  point 
out  some  univariate  PDFs  that  cannot  be  generalized  to  SIRV  characterization.  We 
consider  the  problem  of  determining  the  PDF  of  the  random  vector  =  [Yc^iYs^j 
specified  in  Section  3.2.  It  is  assumed  that  the  mean  vector  of  Y  and  its  covariance 
matrix  S  are  known.  Consequently,  specification  of  the  PDF  of  Y  of  the  form  of 

eq  (3.8)  reduces  to  determination  of  /i2Ar(p). 

3.4.1  Examples  Based  on  the  Characteristic  PDF 

3.4. 1.1  Gaussian  Distribution 

The  Gaussian  marginal  PDF  for  the  quadrature  components  having  mean  bk  and 
variance  al  is 


/n(j/fc)  =  )  (-00  <yk<  oo). 

\J{2-K)ak 

The  characteristic  PDF  for  this  example  is  given  by 


(3.31) 


/s(s)  =  i{s  -  1)  (3.32) 

where  d(.)  is  the  unit  impulse  function.  Using  eq  (2.21),  it  is  seen  that  the  resulting 
hN(p)  is  given  by 

hsip)  =  exp(-|).  (3.33) 

where  p  =  (y  —  —  b).  The  corresponding  PDF  for  any  N  is  given  by 

eq  (2.20).  For  =  1,  this  result  reduces  to  eq  (3.31).  When  Y  is  made  up  of 
quadrature  components,  we  obtain  the  the  corresponding  h2Pi{p)  by  simply  replacing 
N  by  2N  in  eq  (3.33).  Whenever  a  characteristic  PDF  can  be  made  to  approach  a 
unit  impulse  function  displaced  to  the  right  of  the  origin  by  appropriate  choice  of  its 
parameters,  it  follows  that  the  corresponding  SIRV  PDF  will  approach  the  Gaussian 
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PDF. 

3.4.1. 2  K-Distribution 

The  K-distributed  envelope  PDF,  by  definition,  is  given  by 

Oh  hr 

/«(»')  = 

where  a  is  the  shape  paxeimeter  of  the  distribution,  b  denotes  the  scale  parameter  of 
the  distribution,  is  the  order  modified  Bessel  function  of  the  second  kind 

and  u{r)  is  the  unit  step  function.  The  K-distributed  envelope  PDF  is  commonly 
used  for  modeling  radar  clutter  PDFs  that  have  extended  tails  [19,  20]  and  [2,  9).  In 
particular,  the  PDF  becomes  heavy  tailed  as  a  approaches  zero.  Plots  of  eq  (3.34) 
for  several  values  of  a  are  shown  in  Figures  3. 1-3.4. 

The  K-distributed  envelope  PDF  arises  when  we  consider  the  product  of  a  Rayleigh 
distributed  random  variable  R'  and  an  independent  Chi-distributed  random  variable 
V.  More  precisely,  we  consider  the  product  R  =:  R'V,  with  R'  and  V  being  statisti¬ 
cally  independent.  Their  PDFs  are  given  by 

r'p 

fn>{r)  =  r  exp(— 1-^)  0  <  r  <  oo  (3.35) 

and 

2b 

^  — 2~^  0  <  u  <  00,  (3.36) 

respectively.  Consequently,  the  PDF  of  R  is  given  by 


fnir)  =  /o~  fR\v{r\v)fv{v)dv 

From  [35],  we  have 


(3.37) 


K^{xz)  =  Y  Jo  +  y)]^  [Wrgz\  <  j],  2  >  0.  (3.38) 

Letting  =  <  in  eq  (3.37)  and  using  the  result  of  eq  (3.38),  the  PDF  of  eq  (3.34) 
follows. 

The  quadrature  components  corresponding  to  the  Rayleigh  envelope  PDF  are  in¬ 
dependent  identically  distributed  zero  mean  Gaussi^ln  random  variables  having  unit 
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variance.  The  PDF  of  the  quadrature  components  corresponding  to  E!  is  expressed 


fzA^)  =  fz.i^)  =  (27r)-2eip(-y) 


(3.39) 


where  Zc  and  Z,  denote  the  in  phase  and  out  of  phase  quadrature  components.  The 
quadrature  components  arising  from  the  K-distributed  envelope  PDF,  denoted  by  Yc 
and  y,,  respectively,  cam  be  expressed  as 


y  = 


y  =  z.y. 


(3.40) 


Note  that  |y|  =  \Z\V  and  0y  =  0^.  Consequently,  the  PDF  of  y  is  given  by 

fy-iyc)  =  -  f  +  b^v^)]dv.  (3.41) 

’  ^r(a)2“-i  Jo  ^  ’ 

Making  the  change  of  variables  t  =  iP'v^  and  and  using  eq  (3.38),  the  PDF 

of  y  is  expressed  as 


/nto.)  =  r(a)^2°  -  00  <  j(,  <  oo 


(3.42) 


where  the  absolute  value  denoted  by  |.|  is  used  on  account  of  the  requirement  that 
z  >  0.  In  a  similar  manner,  it  can  be  shown  that  the  PDF  of  Y,  has  the  same 
functional  form  as  eq  (3.42).  The  PDF  of  eq  (3.42)  is  called  the  Generalized  Laplace 
PDF  [16]. 


The  characteristic  PDF  for  the  K-distributed  SIRV  is 


fsM  =  j^(6s)^«-exp(-^)u(s). 


(3.43) 


Using  eqs  (2.21)  and  (3.38), 


A«(rt  =  /”»-''exp(-^)j^(63)'“-‘exp(-^)*. 


r(a)2° 


(3.44) 
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Making  the  change  of  variables  t  =  and  the  resulting  h^ip)  is  given  by 

The  corresponding  SIRV  PDF  for  any  N  is  given  by  using  eq  (2.20).  For  the  case 
when  iV  =  1,  this  reduces  to  eq  (3.42).  When  dealing  with  quadrature  components, 

we  use  eq  (3.45)  with  N  replaced  by  2N 

3.4.1.3  Student-t  Distribution 

The  Student-t  distribution  for  the  quadrature  components  is  given  by 

IyM  =  (-00  <  yfc  <  oo),  1/  >  0  (3.46) 

where  6  is  the  scale  parameter,  v  is  the  shape  parameter  r(i^)  is  the  Eulero-Gamma 
function  and  k  =  c,s.  Plots  of  the  Student-t  distribution  are  shown  for  several  values 
of  V  in  Figures  3. 5-3. 7.  The  characteristic  PDF  for  this  example  is 

Use  of  eq  (2.21)  results  in  /liv(p)  being  given  by 


hj^{p)  = 


2^6^‘^r(i/  +  f) 

r(i/)(62  -f  p)^'*'" 


(3.48) 


The  corresponding  SIRV  PDF  for  any  N  is  given  by  eq  (2.20).  For  iV  =  1,  this  result 

reduces  to  eq  (3.46).  When  dealing  with  quadrature  components,  we  make  use  of 

eq  (3.48)  with  N  replaced  by  2N . 

3.4.1.4  Mixture  of  Gaussian  PDFs 

An  interesting  non-Gaussian  marginal  PDF  that  is  admissible  as  an  SIRV  is  the 
mixture  of  Gaussian  PDFs.  We  consider  the  PDF  given  by 


fvM  =  ^exp(- 


iVk  -  hkf 
2kf  ^ 


(3.49) 


for  the  quadrature  components  of  Y.  The  characteristic  PDF  for  this  example  is 
given  by 

/s(5)  =  E««'^(^-^’)-  (3-50) 


43 


:5 


Note  that  5  is  a  discrete  random  variable,  with  a,-  denoting  the  probability  P{S  =  A:,). 
Also,  it  is  required  that 


The  corresponding  SIRV  PDF  for  any  N  is  given  by  eq  (2.20).  For  iV  =  1,  this  result 
reduces  to  eq  (3.49).  When  dealing  with  quadrature  components,  we  make  use  of  the 
result  of  eq  (3.52)  with  N  replaced  by  2N.  Note  that  the  a,-’s  can  be  assigned  any 
desired  discrete  distribution. 

3.4.2  Examples  Based  on  Marginal  Envelope  PDF 

We  shall  report  here  on  some  new  SIRV  PDFs  obtained  starting  from  the  marginal 
envelope  PDF.  Note  in  general,  that  the  characteristic  PDF  for  all  the  examples 
considered  here  are  not  available  in  closed  form.  Since  is  the  common  variance 
of  the  in  phase  and  out  of  phase  quadrature  components,  cr^  is  equal  to  In 

addition,  recall  that  the  binomial  coefficient  is  defined  by 


(3.53) 


In  all  the  examples  in  this  section,  we  start  with  ^12(9)  s^nd  obtain  h2N{q)  by  the 
process  of  successive  differentiation.  The  corresponding  /i2jv(p)  for  each  example  is 
obtained  by  replacing  9  by  p  in  h2N{q)-  In  all  the  examples  presented  in  this  section, 
note  that  the  envelope  PDFs  reduce  to  the  Rayleigh  envelope  PDF  for  appropriately 

chosen  parameters. 

3.4.2. 1  Chi  Envelope  PDF 

We  consider  the  Chi  distributed  envelope  PDF  given  by 

/r(^)  =  ||^(^)^''"^exp(-6V^)  (0  <  r  <  00)  (3.54) 
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where  b  denotes  the  scale  parameter  and  i/  denotes  the  shape  parameter.  Plots  of 
the  Chi  envelope  PDF  are  shown  in  Figures  3.8-3.10  for  several  values  of  v.  Using 
eq(3.14),  we  can  write 


h2{q)  = 


(3.55) 


Using  eq(2.30),  we  have 


hMl)  =  (-2)"-'^^^^ 


(3.56) 


Recall  Leibnitz’s  theorem  for  the  derivative  of  a  product  [35],  which  states  that 


d"(uu)  _  "  ^  d^u 

dx"  ^  .  dx^  dx"“*' 


(3.57) 


where  u  and  v  are  functions  of  x.  Noting  that 


^)  ^  r(t/)  k-\ 

dq'‘  r(i/  —  k) 


(3.58) 


it  follows  that 


'>2JV(?)  =  (-2)''-M  Giq-'’exp(-Bq) 


(3.59) 


where 


N-1 


k-l 


N-k  nN-k 


T{u-k  +  l) 


(3.60) 


An  important  condition  that  must  be  pointed  out  is  that  the  SIRV  PDF  is  valid  only 
for  <  1.  This  is  due  to  the  fact  that  /i2(p)  and  its  derivatives  are  monotonically 
decreasing  functions  only  in  the  range  of  values  of  v  mentioned  above.  Finally,  for 


1/  =  1,  note  that  the  Chi  envelope  PDF  reduces  to  the  Rayleigh  envelope  PDF.  The 

corresponding  SIRV  PDF  then  becomes  Gaussian. 

3.4. 2. 2  Weibull  Envelope  PDF 

The  Weibull  distributed  envelope  PDF  is  given  by 

ffi{r)  =  abr^~^ exp{—ar^)  (0  <  r  <  oo).  (3.61) 


The  Weibull  envelope  PDF  is  admissible  for  charax:terization  as  an  SIRV  for  values 
of  b  less  than  or  equal  to  2.  This  is  due  to  the  fact  that  ^2(9)  its  derivatives 


fail  to  satisfy  the  monotonicity  condition  for  other  values  of  b.  However,  this  is  not  a 
serious  restriction  for  the  point  of  view  of  radar  clutter  modeling  because  the  Weibull 
envelope  PDF  is  of  interest  in  modeling  large  tailed  clutter.  Such  a  situation  arises 
only  when  0  <  6  <  2.  The  Weibull  envelope  PDF  reduces  to  the  Rayleigh  envelope 
PDF  when  6  =  2.  The  corresponding  SIRV  PDF  then  becomes  Gaussian.  Another 
case  of  interest  arises  when  6=1.  In  this  case  the  Weibull  envelope  PDF  corresponds 

to  the  Exponential  envelope  PDF. 

3.4.2.3  Generalized  Rayleigh  Envelope  PDF 

The  next  PDF  considered  is  for  the  Generalized  Rayleigh  envelope  which  is  given 

by 

fnir)  =  (0  <  r  <  oo)  (3.68) 

where  a  is  the  shape  p^l^amete^  and  0  is  the  scale  parameter.  Plots  of  the  Generalized 
Rayleigh  distribution  are  shown  for  several  values  of  a  in  Figures  3.15-3.17. 
Proceeding  as  in  the  previous  example,  we  find  that 

62(9)  =  Aexp{—Bq^)  (3.69) 


Note  that  the  SIRV  PDF  is  valid  only  in  the  range  (0  <  a  <  2).  This  is  because 
of  the  fact  that  the  monotonicity  conditions  for  the  derivatives  of  h2{p)  are  satisfied 
only  for  the  specified  range  of  a.  The  Generalized  Rayleigh  envelope  PDF  reduces  to 
the  Rayleigh  envelope  PDF  when  a  —  2. 
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3.4. 2.4  Rician  Envelope  PDF 

There  are  two  possible  ways  in  which  the  Rician  envelope  PDF  occurs.  One  possi¬ 
bility  arises  through  a  complex  zero  mean  random  process  with  correlated  quadrature 
components  that  are  Gaussian.  The  other  is  through  a  non-zero  mean  complex  Gaus¬ 
sian  process.  The  former  case  is  considered  here,  since  the  SIRV  PDF  can  be  obtained 
by  differentiation  of  hjC?)-  For  this  case,  the  envelope  PDF  is  given  by 


2(1  - 

(0  <  r  <  oo) 

(0  <  p  <  1) 


(3.73) 


where  /o(x)  is  the  modified  Bessel’s  function  of  the  first  kind  of  order  zero.  Plots  of 
the  Rician  envelope  PDF  for  several  values  of  p  are  shown  in  Figures  3.19-3.21.  Let 


2(1 -p2)- 


Using  eq  (3.14)  we  have 


(3.74) 


h,{q)  = 


■,exp{-Aq)Io{pAq). 


(3.75) 


From  eq  (2.30) 


^2n(9)  =  (-2) 


^^2(9) 


dq^~^ 


We  then  use  eq  (3.57)  and  the  identities  [35] 


(3.76) 


7n(x)  =  ^  cos{n9)exp[xcos{6)]d9 


cos^{9)  =  ^  XIm=o  cos[(fc  -  2m)9] 


(3.77) 


to  obtain 


^2N  N-\  N  -I  » 

=  7; - E  (-l)‘(f)‘6eip(-A,)  (3.78) 

U  “  P  J  2  fc=0  L  ^ 

1  K 
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where 


k  k 

^Jfe  =  H  h-2mipAq). 


(3.79) 


For  /?  =  0,  note  that  the  Rician  envelope  PDF  corresponds  to  the  Rayleigh  envelope 
PDF. 

3.4.2.5  Generalized  Gamma  Envelope  PDF 

In  a  recent  effort  [37]  the  Generalized  Gamma  envelope  PDF  has  been  proposed 
as  a  candidate  for  univariate  non-Gaussian  PDFs  for  modeling  radar  clutter.  The 
Generalized  Gamma  envelope  PDF  is  given  by 


^ea:p(-ar^) 

0  <  r  <  oo,  a,  c,  a  >  0 


(3.80) 


where  a  is  the  scale  parameter  and  q  and  c  are  shape  parameters  of  the  PDF.  Note 
that  the  Generalized  Gamma  envelope  PDF  reduces  to: 

1.  the  Weibull  envelope  PDF  when  a  =  1, 

2.  the  Gamma  envelope  PDF  when  c  =  1, 

3.  the  Exponential  envelope  PDF  when  c  =  a  =  1, 

4.  the  Chi  envelope  PDF  when  c  =  2  and 

5.  the  Rayleigh  envelope  PDF  when  c  =  2  and  a  =  1. 

We  show  that  this  PDF  is  admissible  ais  an  SIRV.  Using  eq  (3.14),  we  can  write 


^2(9)  =  Aq‘^~^exp{-Bq^ 


(3.81) 


where  A  =  and  B  =  aa^.  Using  eq(2.30),  we  have 


h2N{q)  =  (-2)^-^ 
{-2)^-^A-^^[q^-^txp{-Bq^ )]. 


(3.82) 
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Using  eq  (3.57)  and  eq  (3.58),  we  can  rewrite  eq  (3.82)  as 


kM<,)  = 

\  ^  J 

(3.83) 

The  A:‘^  derivative  of  the  exponential  term  is  readily  obtained  by  using  eqs  (3.64-3.67). 
Hence,  we  have 


hiNiq)  =  ^*9'°  '^expi-Bq^ 


(3.84) 


where 


F,  =  (-2)' 


N-1 


r(f) 


k  m  pm  -L  1  ^ 

^  ^  rric  u  I 


(3.85) 

The  Generalized  Gamma  envelope  PDF  is  admissible  for  characterization  as  an  SIRV 
for  values  of  cq  less  than  or  equal  to  2.  This  is  due  to  the  fact  that  ^2(9)  and  its 
derivatives  fail  to  satisfy  the  monotonicity  condition  for  other  values  of  ca.  Interest¬ 
ingly  enough,  it  is  only  these  values  of  ca  that  give  rise  to  extended  tails  for  the  PDF. 

Hence,  the  monotonicity  conditions  do  not  impose  a  serious  restriction. 

3.4.3  Examples  Using  the  Marginal  Characteristic  Function 

Successful  use  of  the  marginal  characteristicfunction  approach  requires  the  knowl¬ 
edge  of  various  Hankel  transforms.  For  each  example,  the  particular  transform  used 
is  cited  by  equation  and  page  number  as  it  appears  in  [36].  To  illustrate  the  pro¬ 
cedure  followed,  a  detailed  derivation  is  presented  in  the  first  example.  However,  in 
the  remaining  examples,  we  simply  list  the  univariate  characteristic  function  of  the 
quadrature  components,  the  corresponding  marginal  PDF  and  the  resulting  h2N{q)- 

Finally,  h2N{p)  is  obtained  by  replacing  q  with  p  in  the  expressions  for  /i2iv(g). 

3.4.3.1  Gaussian  Distribution 

First,  we  consider  the  characteristic  function  given  by 


^(w)  =  ezp(-y). 


(3.86) 
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The  corresponding  marginal  PDF  of  the  quadrature  components  is 

frM  =  f)  ^  ^ 


(3.87) 


Equation  (3.87)  is  the  PDF  of  a  zero  mean  unit  variance  Gaussian  random  variable. 
Substitution  of  eq  (3.86)  in  eq  (3.30)  yields 

2 

/■2n(9)  =  (V?)'-"  j(  (3.88) 


From  [36],  eq  (10),  p29,  we  have  the  Hankel  transform 


x'^+^exp{-ax^)Jy{xy)y/xydx  =  -^^-^exp{-—). 


(3.89) 


By  making  the  association  that  a  =  0.5,  i/  =  N  —  1,  x=uj  and  y  =  ^/q,  the  above 


result  becomes 


2 

^  u;^ezp(-y)Jyv_i(wv/9)v/gdw  =  v^^"^'^^exp(-|). 


(3.90) 


It  follows  that 


*2^(9)  =  exp(-p. 


(3.91) 


From  eq  (3.8),  it  is  seen  that  the  resulting  SIRV  PDF  is  the  familiar  multivariate 
Gaussian  PDF,  given  by 


/Y(y)  =  (2T)-^lSl"exp(-^). 


(3.92) 


3.4.3. 2  K-Distribution 

The  marginal  characteristic  function  given  by 


«(*.-)  =  (1  +  p-)-” 


(3.93) 


corresponds  to  the  K-distributed  envelope  whose  PDF  is 

Of)  hr 

r(a)  2 


(3.94) 
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where  a  is  the  shape  parameter  of  the  distribution,  b  denotes  its  scale  parameter, 
KN{t)  is  the  order  modified  Bessel  function  of  the  second  kind  and  u(r)  is  the 
unit  step  function.  The  pertinent  Hankel  transform  for  this  example  is  found  as  [36] 
eq  (20),  p24: 


/  +  a^)  “  ^ Jy{xy)y/xydx  = 

Jo 


2“r(u  + 1) 


(3.95) 


The  resulting  h2N{q)  is 


(3.96) 


As  a  special  case,  when  a  is  equal  to  unity,  eq  (3.93)  is  the  characteristic  function 
of  the  Laplace  distribution  for  the  quadrature  components  whose  PDF  is  given  by 


fYkiVk)  =  2^xp{-b\yk\)  (-00  <yk<oo) 


(3.97) 


where  |t/jt|  denotes  the  absolute  value  of  yk  and  b  denotes  the  scale  parameter.  The 
corresponding  /i27v(9)  is  given  by 


(3.98) 


Another  interesting  ceise  of  the  K-distribution  arises  when  a  =  0.5.  This  corre¬ 
sponds  to  the  exponential  distribution  for  the  marginal  envelope  PDF.  Therefore,  the 
K-distributed  envelope  PDF  with  a  =  0.5  is  identical  to  the  Weibull  distributed  en¬ 
velope  with  6=1.  Although  the  characteristic  PDF  of  the  Weibull  SIRV  is  unknown 
in  general,  the  characteristic  PDF  of  the  Weibull  SIRV  for  6  =  1  is  obtained  when 
a  =  0.5  in  eq  (3.43).  Finally,  we  point  out  that  the  K-distributed  envelope  reduces 

to  the  Rayleigh  envelope  PDF  when  a  tends  to  oo. 

3.4.3.3  Student-t  Distribution 

The  characteristic  function  for  the  Student-t  distribution  with  scale  parameter  6 
and  shape  parameter  u  is  given  by 


^  '  2‘'-^T{u) 


(3.99) 


Note  the  functional  similarity  with  the  envelope  PDF  given  by  eq  (3.94).  The  Student- 
t  distribution  is  referred  to  as  the  generalized  Cauchy  distribution  in  [38]  because  the 
marginal  PDF  of  the  quadrature  components  is  given  by 


(3.100) 


where  r(i/)  is  the  Eulero-Gamma  function.  The  relevant  Hankel  transform,  [36]  eq 
(3),  p63  is 


^  ,  .j,  s  „  2’'+“a“r  u  4 

/  X  +  ^iK^{ax)Jy{xy)y/xydx  = - . 

Jo  (y2  +  a 


2*^-*-“a“r(u  +  v  +  l)y*'+2 

(y2  q.  q2^u+v+i 


(3.101) 


Using  eq  (3.30),  h2N{q)  is  expressed  as 


h2N{q)  = 


2^62*'r(i/  +  N) 

r(«/)(62  +  5)^+- 


(3.102) 


The  Cauchy  PDF  for  the  quadrature  components  arises  when  v  is  set  equal  to  |  in 
eq  (3.100)  and  is  given  by 


where  b  is  the  scale  pcirameter.  The  corresponding  h2Ni<l)  is 

.  2''6r(l  +  JV) 


(3.103) 


(3.104) 


Note  that  the  Cauchy  PDF  does  not  have  finite  variance.  However,  this  PDF  is 
useful  in  modeling  impulsive  noise  [39].  Finally,  we  point  out  that  when  b  =  ■\/2l/ 
and  1/  tends  to  oo  in  eq  (3.100),  the  Student-t  distribution  reduces  to  the  Gaussian 
distribution. 

3.4.3.4  Rician  Envelope  PDF  2 

We  consider  the  Rician  envelope  PDF,  arising  from  a  non- zero  mean  complex  Gaus¬ 
sian  process,  given  by 


Mr)  = 


(3.105) 
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Plots  of  the  Rician  envelope  PDF  are  shown  in  Figures  3.20-3.22  for  several  values  of 
a  and  a  =  1.  Note  that  this  PDF  approaches  the  Rayleigh  PDF  as  a  tends  to  zero. 
For  convenience,  we  assume  that  =  1.  Using  eq  (3.14),  we  have 


dv 

h2{r^)  =  Aexp{—^)h{-^) 


(3.106) 


where  A  = 


Noting  that  [35] 


xexp{-ax^)Wx)M^x)dx  =  iexp(^)J.(g) 

Re{a}  >  0,  Re{i/]  >  -1, 
eq  (3.21)  results  in  the  characteristic  function 

,  ,uja^ 

^(w)  =  exp{ - :^)«^o(-t)- 


(3.107) 


(3.108) 


Recognizing  that  [35] 


2(i+*'+ir(i/+i) 


x^  ^exp{-ax^)Jfi{0x)Jui'rx)dx  = 

T'oo  „  Ulli±t^±ktll(-E)rnft^rn,  -a-m\  u  +  V,  4)  (3-109) 

4-t7»=0  m!r(m+>i-fl)  \  4a>'  ^  ^  )  /32  / 


i?e{a}  >  0,  Re{p  •+  i/  +  A}  >  —2,  /3  >  0,  7  >  0 

where  F(.,  .;  .;  .)  is  the  four  parameter  hypergeometric  function,  it  follows  from 
eq  (3.30)  that 

V  r(m  +  Ar+^  ^  _  ssl  (3 

2'^^+^T{N)  ^0  ^!r(m  -i- 1)  4a®  ^  ^ 

Since  ^2^(9)  for  this  example  involves  an  infinite  series  of  hypergeometric  functions, 
its  form  is  mathematically  intractable.  Therefore,  the  corresponding  multivariate 
SIRV  PDF  does  not  lend  itself  for  use  in  practical  applications. 

We  point  out  here  that  the  log-normal  envelope  PDF  and  the  Johnson  (unbounded) 
distribution  are  not  admissible  for  extension  to  SIRVs.  This  is  due  to  the  fact  that 
^2(9)  obtained  for  each  of  these  distributions  fails  to  satisfy  the  monotonicity  con¬ 
ditions  stated  in  Section  3.3.  Table  3.1,  presents  a  list  of  marginal  PDFs  suitable 
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Figure  3.24:  Rician  Envelope  PDF,  a  =  0.9,  a  =  1 
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Table  3.1:  Marginal  PDFs  Suitable  for  extension  to  SIRVs 


Marginal  PDF 

fxjx)  _ _ 

Chi 

Weibull 

abx^^^exp(—ax^) 

Generalized  Rayleigh 

(f)“i 

Generalized  Gamma 

Rician 

Gaussian 

y/2Tr  ^exp(— 

Laplace 

|eip(-6|n|) 

Cauchy 

-r(»5+r-n 

K-distribution 

Student-t 

WiUZIlflWPIBHI— 

for  extension  to  SIRVs.  Table  3.2  tabulates  /i2n(p)  those  marginal  PDFs  treated 
as  envelope  PDFs  while  Table  3.3  gives  those  /i2n(p)  obtained  from  the  associated 
marginal  characteristic  function. 

Plots  of  eq  (3.8)  with  AT  =  1  for  the  various  SIRV  PDFs  are  shown  in  Figures 
3.25-3.33.  In  all  the  plots,  the  covariance  matrix  used  is  given  by 


S  = 


1  0.5 

0.5  1 


(3.111) 


Observe  that  each  PDF  is  unimodal.  However,  the  width  and  height  of  the  peak 
along  with  the  behavior  of  the  extreme  values  (i.e.  the  tails)  differ  significantly. 

3.5  Significance  of  the  Quadratic  Form  of  the  SIRV  PDF 

Thus  far,  our  discussion  has  focussed  on  techniques  that  can  be  used  to  obtain 
the  PDF  of  an  SIRV  starting  from  either  the  first  order  PDF  or  the  first  order  char¬ 
acteristic  function.  Given  random  data,  we  are  also  interested  in  the  problem  of 
approximating  the  distribution  of  the  underlying  data.  The  problem  of  multivariate 
distribution  identification  is  of  interest  in  radar  signal  detection.  Since  the  back¬ 
ground  clutter  is  not  known  a  priori,  there  is  a  need  to  identify  the  underlying  clutter 
PDF  based  on  measurements  obtained  from  a  given  environment.  Since  the  radar 
processes  N  pulses  at  a  time,  knowledge  of  the  joint  PDF  of  the  N  samples  is  nec¬ 
essary  in  order  to  obtain  the  optimal  radcir  signal  processor  for  the  given  clutter 
background.  We  present  an  important  theorem  here  which  enables  us  to  address  the 


75 


Table  3.2:  SIRVs  obtained  from  the  marginal  envelope  PDF 


Marginal  PDF 


Chi 


Weibull 


f^2Nip) 

(-2)^-Mi:L.G*p''-*exp(-5p) 


Wi) 


B  =  b^<T^ 
u<  1 

:n 


ELiC,pT-^exp{-Api) 

A  =  0(7* 


N) 


b<2 


Gen.  Rayleigh 


EtJi  ^fcP ’““^■'■‘eip(-flpf ) 
A  = 


B  =7?-‘‘(7“ 


a  <  2 


Generalized  Gamma 


f^2N(p)  =  ELV  np^-^exp(-5pl) 

Fi  =  (-2)^~M  f  _ -Y'*  Y'"*  c  im+z-iB**  r(if+i) 

\  k  J  r(^ — A'i-fc+ij  Z^m=i  2^/=iv  )  ^1  r(^— i+i)^ 


cct  <  2 


Rician 


~  IZm=0  ^  m  }  ^^-'2mipA)y  A  —  2(fl7^ 


Table  3.3:  SIRVs  obtained  from  the  marginal  characteristic  function 


Marginal  PDF 

V  _ : 

fi2N(p) 

exp(-£) 

Laplace 

iiiffrtiaifniTifP'ni 

Cauchy 

K-distribution 

Student-t 

76 


Figure  3.25:  Gaussian  distribution,  zero  mean,  unit  variance 


Figure  3.26:  Laplace  Distribution,  6=1 
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distribution  identification  of  an  SIRV. 

Theorem  4  The  PDF  of  the  quadratic  form  appearing  in  eq  (2.20)  is  given  by 

fpiP)  =  {0<p<  oo).  (3.112) 

22r(f) 

Proof:  First,  we  consider  a  spherically  symmetric  random  vector  (SSRV)  X  =  [Xi,  Xj,  . 
Because  an  SSRV  is  a  special  case  of  the  SIRV,  the  representation  theorem  can  be 
used  to  express  X  as 

X  =  Z5  (3.113) 

where  Z  is  a  Gaussian  random  vector  having  zero  mean  and  identity  covariance  matrix 
and  5  is  a  non-negative  random  variable  with  PDF  fs{s).  Consider  the  random 
variable 

P'  =  X^X.  (3.114) 

Using  eq  (3.113)  in  eq  (3.114)  gives 

P'=Z^Z5^  (3.115) 


Since  Z^Z  =  Zf  is  the  sum  of  the  squares  of  independent  identically  distributed 
Gaussian  random  variables  having  zero  mean  and  unit  variance,  the  PDF  of  V  =  Z^Z 
is  a  Chi  square  distribution  with  N  degrees  of  freedom.  Consequently, 


^-1 
V  2 


=  ^^--■^-  exp(--)  ;  u  >  0. 


2fr(f) 

The  transformation  P'  =  VS^  then  results  in 


i^N 


fp'\s(P  I"®) 


-1 


2fr(f)  ^ 


From  the  theorem  of  total  probability,  we  have 


fp'ip) = r 

^0 


N 


-1 


Recall  that 


t 

hsip)  =  s-^exp{—^)fs{s)ds. 


(3.116) 


(3.117) 


(3.118) 


(3.119) 


.,Xiv] 
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Consequently,  the  PDF  of  P'  is  expressed  as 


fp'  (P )  ~ 


(P')^ 


^-1 


2^r(f) 


hs{p  )• 


(3.120) 


Recall  that  an  SIRV  Y  =  [Yi,  Fj,  . . . ,  Fv]^  having  a  mean  vector  b  and  covariance 
matrix  S  is  related  to  the  SSRV  X  by  the  linear  transformation 


Y  =  AX  +  b 


(3.121) 


where  S  =  AA^.  Then,  the  quadratic  form  appearing  in  eq  (3.114)  can  be  expressed 
as 

P  =  {Y -h).  (3.122) 

However,  eq  (3.122)  is  also  the  quadratic  form  appearing  in  eq  (2.20)  which  is  the 
PDF  of  Y.  Since  P  =  P\  the  PDF  of  the  quadratic  form  P  which  is  associated  with 

^(p)  = 

2^  i(y) 

This  establishes  the  theorem.  Thus,  an  SIRV  is  uniquely  characterized  by  the  quadratic 
form  appearing  in  its  PDF.  Knowledge  of  the  quadratic  form  PDF  is  sufficient  to 
identify  the  SIRV  PDF.  This  is  an  important  result  since  it  allows  us  to  reduce  the 
multivariate  distribution  identification  problem  to  the  equivalent  problem  of  univari¬ 
ate  distribution  identification  of  the  quadratic  form.  It  is  emphasized  that  the  PDF 
of  P  is  invariant  to  the  choice  of  n  and  S.  We  point  out  that  the  invariance  of  the 
PDF  of  the  quadratic  form,  arises  from  the  fact  that  an  SSRV  arises  from  a  uniform 
distribution  over  an  N  dimensional  hypersphere  of  radius  R.  The  radius  of  the  hy¬ 
persphere  remains  unchanged  regardless  of  whether  we  consider  an  SIRV  or  an  SSRV. 
Only  the  azimuthal  angles  and  radial  angle  change  depending  on  whether  the  random 
vector  is  a  SSRV  or  an  SIRV.  In  context  of  the  radar  problem,  we  are  dealing  with  N 
complex  samples  or  2N  quadrature  components.  The  results  presented  in  this  section 
are  applicable  when  N  is  replaced  by  2N. 

3.6  Conclusion 

In  this  chapter  we  have  pointed  out  a  method  to  obtain  the  PDF  of  correlated 
non-Gaussiam  ramdom  vectors  arising  in  the  problem  of  radar  clutter  modeling.  The 
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theory  of  SIRPs  has  been  used  to  develop  the  multivariate  PDFs.  Various  techniques 
have  been  presented  to  obtain  SIRV  PDFs.  Several  examples  are  provided  to  illustrate 
these  techniques.  The  admissibility  of  the  Chi  envelope  PDF,  Weibull  envelope  PDF, 
Generalized  Rayleigh  envelope  PDF,  Riciein  envelope  PDF  and  Generalized  Gamma 
envelope  PDF  «is  SIRVs  has  been  pointed  out  for  the  first  time.  Finally,  we  have 
obtained  the  PDF  of  the  quadratic  form  of  a  SIRV  and  we  have  shown  that  this  PDF 
remains  unchanged  regardless  of  whether  we  are  dealing  with  an  SSRV  or  an  SIRV. 
We  have  also  established  that  the  quadratic  form  contains  all  the  information  that 
is  required  in  order  to  identify  the  SIRV  PDF.  As  a  consequence  of  this  result,  the 
problem  of  an  SIRV  (multivariate)  distribution  identification  has  been  reduced  to  the 
equivalent  identification  of  the  univariate  distribution  of  the  non-negative  quadratic 
form. 
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Chapter  4 


Computer  Generation  of 
Simulated  Radar  Clutter 
Characterized  as  SIRPs 


4.1  Introduction 

This  investigation  is  motivated  by  a  desire  to  simulate  correlated  non-Gaussian 
radar  clutter.  Various  investigators  have  reported  experimental  results  where  non- 
Gaussian  marginal  probability  density  functions  (PDF)  have  been  used  to  model  the 
clutter.  Usually,  radars  process  N  samples  at  a  time.  Statistical  characterization  of 
the  clutter  requires  the  specification  of  the  joint  PDF  of  the  N  samples.  In  addition, 
the  clutter  may  be  highly  correlated.  Hence,  the  joint  PDF  must  take  into  account 
the  correlation  between  samples.  Statistical  characterization  of  the  clutter  is  neces¬ 
sary  if  an  optimal  radar  signal  processor  is  to  be  obtained.  For  use  of  the  well  known 
likelihood  ratio  test,  it  is  necessary  to  have  closed  form  expressions  for  the  joint  PDF 
of  the  N  clutter  samples  in  order  to  obtain  the  optimal  radar  signal  processor.  In 
most  cases,  it  is  difficult  to  evaluate  the  performance  of  the  optimal  radar  signal  pro¬ 
cessor  analytically  when  the  clutter  samples  are  correlated  and  non-Gaussian.  Then 
computer  simulation  may  be  necessary.  Therefore,  there  is  a  need  to  develop  efficient 
procedures  that  facilitate  computer  simulation  of  the  clutter.  A  library  of  multi¬ 
variate  non-Gaussian  PDFs  has  been  developed  in  Chapter  3,  using  the  theory  of 
Spherically  Invariant  Random  Processes  (SIRP)  and  Spherically  Invariant 
Random  Vectors  (SIRV)./In  view  of  the  large  number  of  parameters  that  are  free 
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to  be  specified,  the  librajy  of  multivariate  non-Gaussiain  PDFs  can  be  used  to  approxi¬ 
mate  many  different  radar  clutter  scenarios.  In  this  chapter  we  concern  ourselves  with 
the  development  of  computer  simulation  procedures  for  the  library  of  non-Gaussian 
PDFs  obtained  in  Chapter  3  so  that  the  performance  of  any  radar  signal  processor 
can  be  evaluated  for  a  variety  of  different  clutter  scenarios.  Another  issue  addressed 
in  this  chapter  is  performance  assessment  of  the  simulation  procedures. 

It  has  been  pointed  out  in  Chapter  3  that  the  quadratic  form  appearing  in  the 
PDF  of  the  SIRV  contains  ail  the  information  necessary  to  identify  the  PDF  of  the 
underlying  SIRV.  We  mahe  use  of  this  result  in  order  to  cissess  the  performance  of  the 
simulation  procedures.  Some  interesting  simulation  techniques  have  been  proposed 
for  SIRVs  in  [18]  and  [20].  The  technique  suggested  in  [18]  makes  use  of  Meijer’s  G- 
functions.  These  functions  are  generalizations  of  Hypergeometric  functions  which  do 
not  lend  themselves  to  the  development  of  simple  and  elegant  simulation  procedures. 
The  technique  suggested  in  [20]  requires  transformations  from  rectangular  to  spherical 
co-ordinates  and  then  back  again.  Secondly,  this  simulation  procedure  involves  the 
use  of  the  inverse  distribution  function  approach  for  a  rather  complicated  distribution 
function.  The  approach  developed  in  this  chapter  is  simpler  to  implement  than  those 
proposed  in  [18]  and  [20].  In  addition,  a  new  approach  is  proposed  for  assessing  the 
effectiveness  of  the  simulation  procedure. 

The  problem  of  computer  generation  of  correlated  non-Gaussian  radar  clutter  is 
equivalent  to  the  problem  of  generating  random  variables  with  a  jointly  specified 
marginal  PDF  and  covariance  matrix.  While  the  problem  of  generating  random  se¬ 
quences  with  either  a  specified  PDF  or  prescribed  covariance  function  has  been  well 
treated  [34],  the  joint  problem  has  received  limited  attention.  In  general,  it  has 
been  possible  to  control  either  the  PDF  or  the  correlation  function  but  not  both 
simultaneously.  Previous  attempts  [5,  12,  8,  10,  11]  to  address  the  problem  of  gener¬ 
ating  random  sequences  with  jointly  specified  marginal  PDF  and  covariance  function 
have  not  been  successful  because  the  procedures  proposed  therein  made  use  of  zero 
memory  nonlinear  (ZMNL)  transformations  on  a  correlated  Gaussian  sequence  to 
obtain  the  desired  non-Gaussian  sequence.  Consequently,  the  covariance  matrix  of 
the  non-Gaussian  sequence  Weis  related  to  that  of  the  Gaussian  sequence  in  a  rather 
complicated  manner.  Hence,  given  a  certain  covariance  matrix  for  the  non-Gaussian 
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sequence,  it  was  not  possible  to  determine  the  corresponding  covariance  matrix  of  the 
Gaussian  sequence.  Furthermore,  not  all  nonlinear  transformations  gave  rise  to  non¬ 
negative  definite  covariance  matrices  at  their  outputs  [33,  34].  Thus,  using  ZMNL 
transformations  on  a  correlated  Gaussian  sequence  does  not  offer  a  practical  solution 
to  the  joint  problem.  The  techniques  presented  in  this  chapter  successfully  overcome 
the  drawbacks  of  the  previous  efforts.  This  is  due  to  the  fact  that  SIRPs  belong  to 
the  class  of  exogenous  product  models  for  radax  clutter,  which  allows  for  independent 
control  of  the  marginal  PDF  and  correlation  function. 

In  Section  4.2,  we  review  some  definitions  and  background  information  pertaining 
to  the  theory  of  spherically  invariant  random  processes.  Section  4.3  presents  two 
canonical  simulation  proceduresfor  generating  SIRVs.  Performance  assessment  of  the 
simulation  procedures  is  discussed  in  Section  4.4.  Finally,  conclusions  are  presented 
in  Section  4.5. 

4.2  Preliminaries 

We  begin  by  restating  the  definitions  for  a  spherically  invariant  random  vector 
and  a  spherically  invariant  random  process.  A  spherically  invariant  random  vector 
(SIRV)  is  a  random  vector  (real  or  complex)  whose  PDF  is  uniquely  determined  by 
the  specification  of  a  mean  vector,  a  covariance  matrix  and  a  characteristic  first  order 
PDF.  Equivalently,  the  PDF  of  an  SIRV  can  also  be  referred  to  as  an  elliptically 
contoured  distribution.  A  spherically  invariant  random  process  (SIRP)  is  a  random 
process  (real  or  complex)  such  that  every  random  vector  obtained  by  sampling  this 
process  is  an  SIRV.  The  work  of  Yao  [15]  gave  rise  to  a  representation  theorem  which 
can  be  stated  as  follows  (see  Theorem  1); 

If  a  random  vector  is  a  SIRV,  then  there  exists  a  non-negative  random  variable  S 
such  that  the  PDF  of  the  random  vector  conditioned  on  S  is  a  multivariate  Gaussian 
PDF. 

We  consider  the  product  given  by  X  =  Z5,  where  X  =  [Xi . . .  Xyv]^  denotes  the 
SIRV,  Z  =  [Zi ...  Zn]'^  is  a  Gaussian  random  vector  with  zero  mean  and  covariance 
matrix  M  and  S’  is  a  non- negative  random  variable  with  PDF  fs{s).  Since  it  is 
desirable  to  independently  control  the  correlation  properties  and  the  non-Gaussian 
envelope  PDF,  Z  and  S  are  assumed  to  be  statistically  independent.  The  PDF  of  X 
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conditioned  on  S  is  (see  eq  (2.14)) 


/x|s(x|5)  =  (27r)"2  |M|  h  ^exp{-^)  (4.1) 

where  p  is  a  non-negative  quadratic  form  given  by  p  =  and  |M|  denotes  the 

determinant  of  the  covariance  matrix  M.  The  PDF  of  X  is  given  by  (see  eqs  (2.15) 
and  (2.16)) 

/x(x)  =  (27r)~f|M|~U7v(p)  (4.2) 

where 

hN{p)  =  s-^exp{—^)fs{s)ds.  (4.3) 

The  PDF  of  the  random  variable  S  is  called  the  characteristic  PDF  of  the  SIRV. 
Therefore,  it  is  apparent  that  the  PDF  of  a  SIRV  is  completely  determined  by  the 
specification  of  a  mean  vector,  a  covariance  matrix  eind  a  characteristic  first  order 
PDF.  In  addition,  the  PDF  of  the  SIRV  is  a  function  of  a  non-negative  quadratic 
form.  However,  except  for  the  Gaussian  case,  dependence  on  the  quadratic  form  is 
more  complicated  than  the  simple  exponential.  Therefore,  an  SIRP  can  be  regarded 
as  a  generalization  of  the  familiar  Gaussian  random  process.  We  point  out  that  the 
covariance  matrix  of  the  SIRV  is  given  by  S  =  ME{S^)  where  F;(5^)  is  the  mean 
square  value  of  the  random  variable  S.  It  is  seen  that  the  covariance  matrix  of  the 
SIRV  normalized  by  the  mean  square  value  of  S  is  the  covariance  matrix  of  the  Gaus¬ 
sian  random  vector.  Note  that  it  is  possible  to  set  the  covariance  matrix  of  the  SIRV 
equal  to  that  of  the  Gaussian  random  vector  by  requiring  that  E{S'^)  be  equal  to 
unity.  The  desired  non-Gaussian  PDF  can  be  obtained  by  chosing  fs{s)  appropri¬ 
ately.  Thus,  it  is  seen  that  the  SIRV  formulation  for  radar  clutter  modeling  affords 
independent  control  over  the  non-Gaussian  PDF  of  the  clutter  and  its  correlation 
properties.  Several  techniques  are  available  in  Chapter  3  for  obtaining  /i/\/(p).  Note 
that  the  Gaussian  random  vector  is  a  special  case  of  an  SIRV  and  is  obtained  when 
/s(^)  =  d{s  —  1)  where  6(t)  is  the  unit  impulse  function.  An  interesting  interpreta¬ 
tion  of  the  representation  theorem  is  that  every  SIRV  is  the  modulation  of  a  Gaussian 
random  vector  by  a  non-negative  random  variable. 

Many  of  the  attractive  properties  of  Gaussian  random  vectors  also  apply  to  SIRVs. 
The  most  relevant  property  of  SIRVs  for  the  purpose  of  computer  simulation  is  the 
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closure  property  under  linear  transformation  [15]  stated  below  (see  Theorem  2,  Section 
2.3): 

//X  is  an  SIRV  with  characteristic  PDF  fs{s),  then 

Y  =  AX  +  b  (4.4) 


is  also  an  SIRV  with  the  same  characteristic  PDF.  It  is  assumed  that  A  is  a  nonsin¬ 
gular  matrix  and  b  is  a  known  vector  having  the  same  dimension  as  X. 

Theorem  2  provides  us  with  a  powerful  technique  for  simulating  SIRVs.  A  white 
SIRV  is  defined  as  one  that  has  a  diagonal  covariance  matrix.  In  other  words,  the 
components  of  the  white  SIRV  are  uncorrelated  but  not  necessarily  independent.  We 
can  start  with  a  zero  mean  white  SIRV  X  having  identity  covariance  matrix  and 
perform  the  linear  transformation  given  by  eq  (4.4)  to  obtain  an  SIR/  Y  having  a 
non-zero  mean  and  desired  covariance  matrix  S.  The  matrix  A  and  the  vector  b  are 
given  by 

A  =  ED5 

(4.5) 

b  = 

where  E  is  the  matrix  of  normalized  eigen-vectors  of  the  covariance  matrix  E,  D  is 
the  diagonal  matrix  of  eigen-values  of  E  and  fiy  is  the  desired  non-zero  mean  vector. 

In  many  instances  it  is  not  possible  to  obtain  fs{s)  for  an  SIRV  in  closed  form,  even 
though  its  existence  is  guaranteed.  In  such  cases,  an  alternate  approach  must  be  used 
in  order  to  characterize  the  SIRV.  The  following  theorem  can  be  used  to  completely 
characterize  a  white  SIRV  having  zero  mean  and  identity  covariance  matrix  (see 
Theorem  3,  Section  2.3): 

A  random  vector  X  =  [Xj . . .  ts  a  zero  mean  white  SIRV  having  identity 

covariance  matrix  if  and  only  if  there  exist  random  variables  R  G  (0,oo),  0  G  (0,27r) 
and  $jt  G  (0,  x),  (fc  =  I, ...  N  —  2)  such  that  when  the  components  ofX  are  expressed 
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in  the  generalized  spherical  coordinates 


Xi  =  i?cos($i) 

Xfc  =  i?cos($,)nf=i'  sin($.)  {l<k<N -2) 

Xn-i  =  R  cos(0)  sin($.)  (4-6) 

XN  =  Rsm{Q)n^Jl^sm{^i) 


then  the  random  variables  R,  0  and  are  mutually  statistically  independent  and 
have  PDFs  of  the  form 


Uki<l>k)  =  ^^^^sin^~'^~'’{<i>k)[u{(f>k)  -  u{4>k  -  tt)] 
fe{6)  =  {2ir)~'^[u{9)  -  u{9  -  2n)] 


where  r(i/)  is  the  Eulero  Gamma  function  and  u{t)  is  the  unit  step  function. 

As  a  consequence  of  Theorem  3,  any  SIRV  with  zero  mean  and  identity  covariance 
matrix  can  be  represented  in  generalized  spherical  coordinates  which  are  mutually 
and  statistically  independent  regardless  of  the  SIRV  considered.  Also,  note  that  the 
PDFs  of  0  and  $*;,  (fc  =  1, ...  TV  —  2)  are  functionally  independent  of  the  white  SIRV 
considered.  Only  the  PDF  of  R  chcinges  from  one  white  SIRV  to  another.  Note  that 
R'^  =  EfcLi  ^k  =  X^X.  Hence  R  is  the  norm  of  the  SIRV. 

Another  important  feature  of  the  SIRV  is  that  the  quadratic  form  appearing  in 
its  PDF  contains  all  the  information  necessary  to  identify  the  PDF.  It  follows  that 
knowledge  of  the  PDF  of  the  quadratic  form  of  the  SIRV  is  sufficient  to  identify  the 
PDF  of  the  corresponding  SIRV  [21]  (see  Theorem  4): 

The  PDF  of  the  quadratic  form  appearing  in  eq  (4-2)  is  given  by 

fp{p)  =  (0<p<oo)  (4.8) 

2  2  i  (  2  ) 
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and  remains  unchanged  regardless  of  whether  or  not  the  SIRV  is  white. 

The  theorems  reviewed  in  this  section  will  be  made  use  of  in  the  proposed  simulation 
approach,  discussed  in  Section  4.3,  and  in  assessing  the  performance  of  the  simulation 
procedure,  discussed  in  Section  4.4. 

In  the  context  of  the  problem  of  radzir  clutter  modeling  and  simulation,  the  band¬ 
pass  process  y(t)  =  Re[Y{t)exp{juJot)]  can  be  expressed  in  terms  of  the  corresponding 
complex,  wide  sense  stationary  raoidom  processes  y(t).  More  precisely,  we  obtain  N 
complex  samples  by  sampling  the  complex  random  process  Y{t)  =  Yc{t)  +  jYt{t), 
where  the  subscripts  c  and  s  denote  the  in  phase  eind  out  of  phase  quadrature  compo¬ 
nents.  This  is  equivalent  to  working  with  a  real  vector  of  2N  quadrature  components 
which  is  the  approach  taken  in  this  chapter.  Therefore,  the  results  presented  in  this 
section  are  applied  to  the  problem  of  radar  clutter  modeling  with  N  replaced  by  2N . 
For  ease  of  reference,  the  library  of  non-Gaussian  SIRV  PDFs  obtained  in  Chapter 
3  is  repeated  here.  However,  /i2iv(p)  for  those  SIRVs  for  which  the  characteristic 
PDF  is  known  are  listed  in  Table  4.1.  The  corresponding  characteristic  PDFs  are 
listed  in  Table  4.2.  Table  4.3  lists  h2N{p)  for  those  SIRVs  whose  characteristic  PDF 
is  unknown. 

4.3  Two  Canonical  Simulation  Procedures  for  Generating 
SIRVs 

In  this  section,  we  concern  ourselves  with  two  simulation  procedures  for  generating 
the  SIRVs  listed  in  Table  4.1  and  Table  4.2.  The  first  simulation  procedure  to  be 
discussed  is  applicable  when  the  characteristic  PDF,  fs{s),  is  known.  For  each  of 
the  PDFs  listed  in  Table  4.1,  the  characteristic  PDF  fs{s)  is  tabulated  in  Table  4.3, 
where  E{S^)  =  1.  Since  the  representation  theorem  results  in  the  covarifince  matrix 
of  the  SIRV  being  given  by  S  =  ^^£(5^),  the  choice  of  E{S^)  =  1  makes  E  identical 
to  M,  the  covariance  matrix  of  the  Gaussian  random  vector  Z.  However,  as  shown 
in  Table  4.4,  the  PDFs  for  the  distributions  in  Table  4.1,  a^  commonly  expressed,  do 
not  have  unit  mean  square  value.  In  order  to  obtciin  the  random  variable  S,  with 
unit  mean  square  value,  and  the  corresponding  PDF  fs{s),  we  generate  the  random 
vBiriable  V  having  PDF  /v(u)  and  mean  square  value  E{V^)  =  a^,  and  perform  the 
scaling  5  =  ^  to  obtain  the  desired  S.  For  each  marginal  PDF  listed  in  Table  4.1, 
and  Table  4.4,  the  scade  parameters  b  are  identical  and  so  are  the  shape  parauneters 
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V  and  u(t;)  denotes  the  unit  step  function.  The  simulation  procedure  for  these  SIRV 
PDFs  is  fairly  simple  and  is  stated  below; 

(1)  Generate  a  sample  vector  of  a  white  zero  mean  Gaussian  random 
vector  Z,  having  identity  covariance  matrix. 

(2)  Then  generate  a  sample  value  of  the  random  variable  V  from  the 
PDF  fv{v).  Denote  the  mean  square  value  of  V  by  a^. 

(3)  Normalize  the  sample  value  of  the  random  variable  V  by  a  to 
obtain  a  sample  value  of  the  modulating  random  variable  S.  In 
other  words  generate  S  = 

(4)  Generate  the  product  corresponding  to  X  =  ZS.  At  this  step, 
we  have  a  sample  vector  of  a  white  SIRV  having  zero  mean  and 
identity  covariance  matrix. 

(5)  Finally,  perform  the  linear  transformation  given  by  eq  (4.5)  to 
obtain  a  sample  vector  of  the  SIRV  Y  with  desired  mean  and 
covariance  matrix. 

Fig  4.1  shows  the  simulation  procedure  presented  above. 

The  subroutine  RNNOR  in  IMSL  was  used  for  generating  the  sample  vectors  of 
the  Gaussian  random  vector  Z.  Interestingly  enough,  the  PDFs  listed  in  Table  4.4 
can  be  related  to  the  PDF  of  the  Gamma  distribution  eis  discussed  below.  The  PDF 
fv{v)  for  the  K-distributed  SIRV  is  a  Chi  PDF.  We  first  address  the  random  variable 
generation  for  the  Chi  PDF  and  then  provide  the  transformations  for  obtaining  the 
random  variables  for  the  other  PDFs  listed  in  Table  4.4. 

Consider  the  standard  Gamma  distribution  given  by 

Mt)  =  ^  >  0  (4.9) 

where  a  denotes  the  shape  parameter  and  r(a)  is  the  Eulero-  Gamma  function. 
The  random  variable  V  for  the  Chi  PDF  is  obtained  by  the  transformation  V  = 
Samples  of  the  random  variable  T  are  readily  generated  by  using  the  IMSL  subroutine 
RNGAM.  The  procedure  for  generating  the  Chi  distributed  random  samples  needed 
for  the  K-distributed  SIRV  is  summarized  below. 
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Table  4.1:  h^rfip)  for  SIRVs  with  Known  Characteristic  PDF 


Marginal  PDF 

h2ff{p) 

Laplace 

Cauchy 

PTFfr+N) 

K-distribution 

Student-t 

1.  Generate  samples  of  the  random  variable  T  for  the  steindard  Gamma 
distribution  of  eq  (4.9)  by  using  the  IMSL  subroutine  RNGAM. 

2.  Perform  the  transformation  V  = 

The  PDF  fv{v)  for  the  Laplace  SIRV  is  a  Rayleigh  PDF  and  is  obtained  from 
that  of  the  K-distributed  SIRV  by  letting  a  =  1.  The  random  variable  V  for  the 
PDF  fv{v)  listed  in  Table  4.4  for  the  Student-t  SIRV  is  obtained  from  the  standard 
Gamma  PDF  of  eq  (4.9)  by  the  transformation  V  =  and  letting  a  =  v.  Finally, 
the  PDF  fv{v)  for  the  Cauchy  SIRV  is  obtained  from  that  of  the  Student-t  SIRV  by 
letting  V  —  The  procedure  for  generating  the  random  random  samples  needed  for 
the  Student-t  SIRV  is  summarized  below. 

1.  Generate  samples  of  the  random  variable  T  for  the  standard  Gamma 
distribution  of  eq  (4.9)  by  using  the  IMSL  subroutine  RNGAM. 

2.  Perform  the  transformation  V  = 

We  now  concern  ourselves  with  the  second  simulation  procedure  which  is  applicable 
when  the  characteristic  PDF  is  unknown,  as  is  the  case  for  SIRVs  listed  in  Table 
4.2.  This  alternate  approach  makes  use  of  Theorem  3.  In  particular,  this  procedure 
requires  the  capability  to  generate  the  independent  random  variables  i?,  0  and  $jt 
(fc  =  1, 2, . . . ,  2).  Generation  of  the  random  variables  0  and  {k  =  1, 2, . . . ,  TV— 

2)  is  extremely  difficult  from  a  computational  standpoint.  This  problem  is  overcome 
as  follows. 

Recall  that  the  PDFs  of  0  and  {k  =  1,2, . . .  ,TV  —  2)  are  remain  unchanged 
regardless  of  the  white  SIRV  considered.  Only  the  PDF  of  R  changes  from  one  white 
SIRV  to  another.  Furthermore,  since  a  Gaussian  random  vector  is  a  member  of  the 
family  of  SIRVs,  a  white  Gaussian  random  vector  having  zero  mean  and  identity 
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Table  4.2:  /i2n(p)  for  SIRVs  with  Unknown  Characteristic  PDFs 


Table  4.3:  Characteristic  PDF  for  SIRVs  listed  in  Table  4.1  [E{S^)  =  1] 


Marginal  PDF 

fsis) 

Laplace 

a6^sexp(— 

Cauchy 

K-distribution 

*  V  )u(s) 

Student-t 

‘(as)  ^)u{s) 

Table  4.4:  Related  PDF  fv{v) 


Marginal  PDF 

fv(v) 

wsBmaii 

Laplace 

b^vexp{—^^)u(v) 

2 

17 

Cauchy 

b^v-^expi—^)u(v) 

00 

K'distribution 

2a 

TT 

Student-t 

Figure  4.1;  Simulation  Scheme  for  SIRVs  with  Known  Characteristic  PDF 


Figure  4.2:  Simulation  Scheme  for  SIRVs  with  Unknown  Characteristic  PDF 
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covariance  matrix  admits  a  representation  of  the  form  of  eq  (4.6).  It  follows  that 


—  =  —  A:  —  1  2  N 

It  JXG 


(4.10) 


where  R  is  the  norm  of  the  desired  white  SIRV  and  Rq  is  the  norm  of  the  zero  mean 
white  Gaussian  random  vector.  Consequently,  the  components  of  the  desired  white 


SIRV  are  obtained  as 


Xk  =  -^R  A:  =  l,2,...,iV 
tic 


(4.11) 


The  simulation  procedure  is  stated  below: 

(1)  Generate  a  sample  vector  of  the  white,  zero  mean  Gaussian  ran¬ 
dom  vector  Z  having  identity  covariance  matrix. 

(2)  Compute  the  norm  Rq  =  |1Z1|  =  VZ'^Z  of  the  sample  vector  Z. 

(3)  Generate  a  sample  of  the  norm  R=  ||X||  =  of  the  white 

SIRV  from  the  PDF  of  R  given  by  eq  (4.7). 

(4)  Generate  a  sample  vector  of  the  white  SIRV  X  by  computing 
X  =  R. 

(5)  Finally,  perform  the  linear  transformation  given  by  eq  (4.5)  to 
obtain  a  sample  of  the  SIRV  Y  with  desired  mean  and  covariance 
matrix. 

The  simulation  procedure  is  shown  schematically  in  Fig  4.2.  Note  that  this  simulation 
procedure  avoids  the  explicit  generation  of  the  variables  0  and  {k  =  I, . . .  N  — 
2).  The  generation  procedure  for  a  white  Gaussian  random  vector  is  well  known. 
Therefore,  we  need  to  concern  ourselves  only  with  the  development  of  a  suitable 
generation  scheme  for  samples  of  the  norm  R  of  the  white  SIRV  X.  Generation  of 
the  samples  of  R  is  not  trivial.  This  is  due  to  the  fact  that  the  PDF  of  R  is  generally 
not  in  a  simple  functional  form.  Consequently,  it  may  not  be  possible  to  conveniently 
evaluate  analytically  the  distribution  function  and  its  inverse.  Hence,  generation 
methods  based  on  the  inverse  distribution  function  do  not  olfer  a  practical  solution 
to  this  problem.  Therefore,  in  this  chapter  we  generate  samples  of  R  by  making  use 
of  the  approach  called  the  ‘Rejection  Method’.  The  rejection  method  can  be  used  to 
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generate  samples  of  random  variables  whose  cumulative  distribution  functions  are  not 
known,  but  whose  PDFs  are  known  explicitly  [40].  The  rejection  procedure  assumes 
knowledge  of  the  majcimum  value  of  the  PDF  of  R  for  a  given  SIRV  PDF  and  an 
estimate  for  the  finite  range  of  the  PDF  of  R  so  that  the  area  under  the  PDF  curve  is 
close  to  unity.  These  qumtities  eu'e  denoted  by  c  and  b,  respectively.  We  discuss  the 
rejection  procedure  in  detail  in  Appendix  B.  The  Rejection  method  is  summarized 
below: 

(1)  Generate  a  uniform  random  variate  U\  on  the  interval  (0, 6). 

(2)  Generate  another  uniform  variate  U2  on  the  interval  (0,c). 

(3)  If  U2  <  fniUi),  then  R  =  U\.  Otherwise,  reject  U\  and  return  to 
step  1. 

Note  that  the  simulation  procedures  of  Fig  4.1  and  Fig  4.2  are  canonical  in  the  sense 
that  their  forms  remain  unchanged  from  the  simulation  of  one  SIRV  to  another.  Even 
though,  the  scheme  of  Fig  4.2  can  be  used  even  when  fs{s)  is  known,  the  scheme  of  Fig 
4.1  is  preferred  when  S  Ccin  be  generated  easily.  The  linear  transformation  of  eq  (4.5) 
is  a  filtering  operation.  In  both  schemes,  pre-modulation  filtering  is  equivalent  to 
post-modulation  filtering.  This  results  from  the  fact  that  the  representation  theorem 
is  valid  whether  or  not  the  SIRV  X  and  the  Gaussian  random  vector  Z  are  white. 

4.4  Performance  Assessment  of  the  Simulation  Schemes 

In  this  section  we  concern  ourselves  with  the  performance  assessment  of  the  simula¬ 
tion  procedures  developed  in  section  4.3.  We  point  out  that  the  simulation  procedures 
developed  in  section  4.3  are  exact  in  the  sense  that  they  are  derived  without  approxi¬ 
mation  from  theory.  Hence,  departures  from  the  exact  SIRVs  will  depend  for  the  most 
pcirt  on  the  nonideality  of  the  uniform  rzuidom  number  generators  and  on  the  number 
of  samples  used.  Empirical  assessment  of  the  simulation  procedures  is  necessary  for 
practical  applications. 

One  possible  approach  for  assessing  the  distributional  properties  of  the  simulated 
data  is  to  perform  a  hypothesis  test  on  the  marginal  distributions  of  the  components 
of  the  SIRV.  More  precisely,  the  problem  is  stated  as  follows. 

Ho'.The  hypothesis  that  the  simulated  data  is  from  the  desired  distribution 
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Hi’.The  hypothesis  that  the  simulated  data  is  not  from  the  desired  distribution. 

For  a  fixed  Type-1  error  probability  (i.e.,  the  probability  that  Hi  is  accepted  given 
that  Ho  is  true)  each  marginal  distribution  can  be  checked  by  employing  one  of  the 
commonly  used  goodness  of  fit  procedures.  Since  the  components  of  the  random 
vectors  are  not  statistically  independent,  we  are  now  confronted  with  the  problem 
of  developing  a  goodness  of  fit  test  for  the  multivariate  data.  In  general,  it  is  very 
difficult  to  obtain,  the  overall  significance  level  of  the  test  (i.e.,  the  probability  that 
Ho  is  accepted  given  that  Ho  is  true)  for  the  multivariate  goodness  of  fit  testing 
procedure. 

However,  an  attractive  feature  of  SIRVs  is  that  the  quadratic  form  p  appearing  in 
the  SIRV  PDF  contains  all  the  information  necessary  for  identifying  the  PDF  of  the 
SIRV.  In  other  words,  knowledge  of  the  PDF  of  the  quadratic  form  is  sufficient  to 
determine  the  underlying  SIRV  PDF.  Furthermore,  the  quadratic  form  PDF  remains 
unchanged  regardless  of  whether  the  SIRV  is  white  or  colored.  The  PDF  of  the 
quadratic  form  appearing  in  the  SIRV  PDF  is  given  by  eq  (4.8).  For  the  radar 
problem  where  we  deal  with  N  complex  samples  or  2N  quadrature  components,  note 
that  we  make  use  of  eq  (4.8)  with  N  replaced  by  2N.  Hence,  we  base  our  goodness 
of  fit  test  procedure  for  the  generated  SIRVs  on  the  PDF  of  the  quadratic  form  p. 
Note  that  we  have  now  reduced  the  multivariate  problem  to  an  equivalent  univariate 
problem  involving  the  goodness  of  fit  test  for  the  PDF  of  the  quadratic  form. 

In  the  examples  presented  in  this  section,  we  generated  m  =  1000  realizations  of 
the  random  vector  Y  with  N  =  2  complex  samples  and  from  these  computed  one 
thousand  samples  of  the  quadratic  form  P  for  each  of  the  non-Gaussian  SIRVs  whose 
PDFs  are  listed  in  Tables  4.1  and  4.3.  In  each  case,  we  used  the  corresponding 
theoretical  PDF  of  the  quadratic  form  given  by  eq  (4.8)  to  test  for  the  distribution 
of  the  generated  quadratic  form.  The  frequency  histograms  for  the  generated  data 
and  the  corresponding  theoretical  PDFs  are  shown  in  Figures  4.3-4.10.  In  addition,  a 
Chi-Square  test  was  performed  on  the  generated  data  with  the  Type-1  error  fixed  at 
0.05  and  the  null  hypothesis  was  not  rejected  in  each  case.  The  frequency  histograms 
provide  a  good  idea  about  the  true  distributions  for  large  sample  sizes.  Observe  that 
the  empirical  PDFs  are  very  close  to  the  theoretical  PDFs.  Note  that  the  procedure 
used  in  this  section  to  assess  the  distributional  assumptions  of  the  random  samples 
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fpip) 


Figure  4.3:  Theoretical  and  Empirical  Quadratic  form  PDFs  for  Laplace  SIRV 

from  the  SIRV  PDFs  is  a  formal  goodness  of  fit  test.  Similar  procedures  have  been 
proposed  to  test  for  multivariate  normality  in  [41,  42]. 

4.5  Conclusions 

In  this  Chapter,  we  have  presented  two  schemes  that  can  be  used  in  practice  to 
simulate  correlated  non-gaussian  radar  clutter,  when  the  clutter  can  be  modeled  as 
a  spherically  invariant  random  process.  We  pointed  out  that  the  simulation  schemes 
developed  are  canonical  schemes  and  do  not  change  form  &om  the  simulation  of  one 
SIRV  to  another.  A  new  approach,  based  on  the  PDF  of  the  quadratic  form  appearing 
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Figure  4.5:  Theoretical  and 
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Figure  4.6:  Theoretical  and  Empirical  Quadratic  form  PDFs  for  Student-t  SIRV 
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Figure  4.9:  Theoretical  and  Empirical  Quadratic  form  PDFs  for  Weibull  SIRV 


109 


fpip) 


Figure  4.10:  Theoretical  and  Empirical  Quadratic  form  PDFs  for  Rician  SIRV 
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in  the  SIRV  PDF,  was  used  to  perform  a  goodness  of  fit  test  in  order  to  assess 
performance  of  the  proposed  simulation  schemes.  Performance  assessment  based  on 
this  scheme  showed  excellent  agreement  between  the  theoretical  and  empirical  PDFs 
of  the  quadratic  form.  Finally,  it  was  pointed  out  that  use  of  this  technique  reduced 
the  goodness  of  fit  test  from  a  multivariate  testing  procedure  to  a  univariate  testing 
procedure  resulting  in  tremendous  processing  simplicity.  Therefore,  this  procedure 
lends  itself  very  well  to  practical  applications. 
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Chapter  5 

Distribution  Approximation  to 
Radar  Clutter  Characterized  by 
SIRPs 


5.1  Introduction 

This  investigation  is  motivated  by  a  desire  to  characterize  correlated  non-Gaussian 
radar  clutter  by  approximating  the  underlying  probability  density  function  of  the 
clutter.  Various  investigators  have  reported  experimental  results  where  non-Gaussian 
marginal  probability  density  functions  (PDF)  have  been  used  to  model  the  clutter. 
Usually,  radars  process  N  samples  at  a  time.  Statistical  characterization  of  the  clutter 
requires  the  specification  of  the  joint  PDF  of  the  N  samples.  In  addition,  the  clutter 
may  be  highly  correlated.  Hence,  the  joint  PDF  must  take  into  account  the  correlation 
between  samples.  Statistical  characterization  of  the  clutter  is  necessary  if  an  optimal 
radar  signal  processor  is  to  be  obtained.  For  use  of  the  well  known  likelihood  ratio 
test,  it  is  desirable  to  have  a  closed  form  expression  for  the  joint  PDF  of  the  N  clutter 
samples  in  order  to  obtain  the  optimal  radar  signal  processor.  The  joint  PDF  of  the 
N  clutter  samples  can  be  easily  specified  when  the  clutter  is  Gaussian.  However, 
when  the  clutter  is  non-Gaussian  and  is  correlated,  many  different  joint  PDFs  of  the 
clutter  samples  can  result  in  the  same  set  of  marginal  (univaxiate)  distributions  having 
a  specified  non-Gaussian  character.  The  multivariate  non-Gaussian  PDF  is  uniquely 
determined  from  the  marginal  distribution  only  when  the  samples  are  statistically 
independent. 
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Specification  of  the  multivariate  PDF  is  generally  a  non-  trivial  problem  with  no 
simple  best  solution  [43].  The  theory  of  Spherically  Invariant  Random  Processes 
(SIRP)  provides  a  powerful  mechanism  to  obtain  the  joint  PDF  of  the  N  correlated, 
non-Gaussian  clutter  scunples.  Many  of  the  tractable  properties  of  the  Gaussian  ran¬ 
dom  process  also  apply  to  SIRPs.  Typically,  background  clutter  is  not  known  a  priori. 
Hence,  while  dealing  with  real  world  data,  there  is  a  need  to  approximate  the  clutter 
PDF  from  a  set  of  measurements.  In  order  to  approximate  the  underlying  clutter 
PDF,  there  is  a  need  for  a  library  of  multivariate  non-Gaussian  PDFs.  Such  a  library 
has  been  obtained  in  Chapter  3  based  on  the  theory  of  SIRPs.  The  multivariate 
PDFs  thus  obtained  axe  functions  of  non-negative  quadratic  forms.  Therefore,  these 
PDFs  are  sometimes  referred  to  as  elliptically  symmetric  distributions.  The  multi¬ 
variate  Gaussian  PDF  belongs  to  the  family  of  SIRPs.  The  multivariate  Pearson  types 
II  and  VII  are  examples  of  elliptically  symmetric  multivariate  non-Gaussian  PDFs. 
SIRPs  have  received  considerable  attention  over  the  past  two  decades  since  many 
of  the  elegant  and  mathematically  tractable  properties  of  the  multivariate  Gaussian 
distribution  generalize  to  this  class  of  distributions.  Applications  of  SIRPs  can  be 
found  in  the  random  flight  problem  [14],  signal  detection  [16],  speech  signal  modeling 
[17]  cind  radar  clutter  modeling  [19,  21]. 

In  practice,  the  clutter  PDF  encountered  in  radar  signal  processing  is  not  known 
a  priori.  Consequently,  a  scheme  that  approximates  the  clutter  PDF  based  on  a  set 
of  measured  data  is  necessary.  Currently,  available  tests  such  as  the  Kolmogorov- 
Smirnov  test  and  the  Chi-Square  test  address  the  problem  of  goodness-of-fit  for  ran¬ 
dom  data.  In  particulair,  these  tests  provide  information  about  whether  a  set  of  ran¬ 
dom  data  is  statistically  consistent  with  a  specified  distribution,  to  within  a  certain 
confidence  level.  However,  if  the  specified  distribution  is  rejected,  these  tests  cannot 
be  used  for  approximating  the  underlying  PDF  of  the  random  data.  Moreover,  these 
tests  require  large  sample  sizes  for  reliable  results. 

In  practice,  only  a  small  number  of  samples  may  be  available.  Therefore,  the 
scheme  used  should  be  efficient  for  small  sample  sizes.  A  new  algorithm  based  on 
sample  order  statistics  has  been  developed  in  [41]  for  univariate  distribution  identifi¬ 
cation.  This  algorithm  has  two  modes  of  operation.  In  the  first  mode,  the  algorithm 
performs  a  goodness-of-fit  test.  Specifically,  the  test  determines,  to  a  desired  con- 
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fidence  level,  whether  reindom  data  is  statistically  consistent  with  a  specified  prob¬ 
ability  distribution.  In  the  second  mode  of  operation,  the  algorithm  approximates 
the  PDF  underlying  the  random  data.  In  pairticulax,  by  analyzing  the  random  data 
and  without  any  a  priori  knowledge,  the  algorithm  identifies  from  a  stored  library 
of  PDFs  that  density  function  which  best  approximates  the  data.  Estimates  of  the 
scale,  location,  and  shape  parameters  of  the  PDF  cire  provided  by  the  algorithm.  The 
algorithm  typically  works  well  with  sample  sizes  which  may  be  as  small  as  50  and 
100  saunples.  An  extension  of  this  adgorithm  for  the  multivariate  Gaussian  PDF  has 
been  considered  in  [41,  44]. 

In  this  Chapter,  using  certain  properties  of  SIRPs,  we  adopt  the  algorithm  devel¬ 
oped  in  [41]  to  identify  the  underlying  distribution  of  a  given  set  of  data.  In  particular, 
we  first  show  that  the  multivariate  distribution  approximation  problem  for  SIRPs  is 
reduced  to  an  equivalent  univariate  distribution  approximation  problem.  The  new  al¬ 
gorithm  developed  by  Ozturk  in  [41]  is  used  for  the  univariate  approximation  problem. 
Section  5.2  presents  definitions.  Sections  5. 3-5.5  summarize  the  algorithm  developed 
in  [41]  for  approximating  the  univariate  PDF  of  a  set  of  random  data.  In  Section 
5.6  we  present  a  procedure  for  the  goodness  of  fit  test  for  PDFs  arising  from  SIRPs. 
The  proposed  distribution  identification  algorithm  is  discussed  in  Section  5.7.  Sec¬ 
tion  5.8  proposes  a  method  to  estimate  the  shape  parameter  based  on  the  procedure 
developed  in  Section  5.7.  Finally,  conclusions  are  presented  in  Section  5.9. 

5.2  Definitions 

Let  /y(t/)  denote  the  PDF  of  a  random  variable  Y.  Consider  the  linear  transfor¬ 
mation  defined  by 

x  =  0y  +  a  (5.1) 

The  PDF  of  X  is  given  by 

A(x)  =  |^/H^)  (5.2) 
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where  a  and  ^  are  defined  to  be  the  location  and  scale  parameters  of  fx{x),  respec¬ 
tively.  The  mean  fix  and  vciriance  (7*  of  the  random  variable  X  are  given  by 


/xx  =  E[X] 

al  =  E[{X-fixn 


(5.3) 


Although  the  mean  and  the  variaince  axe  related  to  the  location  and  scale  parameters, 
note  that  the  location  parameter  is  not  the  mean  value  and  the  scale  parameter  is  not 
the  square  root  of  the  variance,  in  generad.  However,  for  a  standardized  Gaussian  PDF 
fyiy)  for  which  the  mean  is  zero  and  the  variance  is  unity,  the  location  parameter  is 
the  mean  of  X  and  the  scale  parameter  is  the  standard  deviation  (square  root  of  the 


variance)  of  X. 

The  coefficient  of  skewness,  as,  and  the  coefficient  of  kurtosis,  04,  of  X,  are  defined 
to  be 


as  = 


<^1 


04 


(5.4) 


It  is  readily  shown  that  as  and  a4  are  invariant  to  the  values  of  fix  and  (Tx-  For 
any  PDF  that  is  symmetric  about  the  mean,  as  =  0.  For  the  case  of  the  Gaussian 
distribution,  as  =  0  and  a4  =  3. 


5.3  Goodness  of  Fit  Test 

In  this  section,  we  introduce  a  general  graphical  method  for  testing  whether  a  set 
of  random  data  is  statistically  consistent  with  a  specified  univariate  distribution.  The 
proposed  method  not  only  yields  a  formal  goodness-of-fit  test  but  also  a  provides  a 
graphical  representation  that  gives  insight  into  how  well  the  random  data  is  repre¬ 
sentative  of  the  specified  distribution  (null  hypothesis).  Using  the  standard  normal 
distribution  with  zero  mean  and  unit  variance  as  a  reference  distribution,  the  stan¬ 
dardized  sample  order  statistics  are  represented  by  a  system  of  linked  vectors.  The 
terminal  point  of  these  linked  vectors,  as  well  as  the  shape  of  their  trajectories,  are 
used  in  determining  whether  or  not  to  accept  the  null  hypothesis. 

In  this  section  we  first  give  a  brief  description  of  the  corresponding  test  statistic  and 
then  explain  the  goodness  of  fit  test  procedure.  For  illustration  purposes,  we  consider 
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the  null  distribution  to  be  Gaussian.  However,  the  proposed  procedure  works  for  any 
null  hypothesis. 

Let  X,  ;  i  =  1, 2, . . .  n  denote  the  sample  from  a  Gaussian  distribution  with  mean 
fi  and  variance  <t^.  Let  X^n  <  X2:n  <  •  •  •  <  Xn-.n  denote  the  ordered  samples  obtained 
by  ordering  X,;  i  =  1, 2, . . .  n.  We  define 


y:  =  '  i  =  l,2,...,n  (5.5) 

where  X  =  EXi/n  is  the  sample  mean  and  S  =  {SCA",-  —  A)^/(n  —  is  the 

sample  standard  deviation.  The  standardized  order  statistics  are  denoted  by  li;„ 
t  =  1, 2, . . .  n  and  are  obttiined  by  ordering  the  Vv;  i  =  1, 2, . . .  n.  It  follows  that 


y;=„  = 


i  =  1,2,.., 


The  linked  vector  is  characterized  by  its  length  and  orientation  with  respect  to 
the  horizontal  axis.  Let  Gi^denote  the  order  statistics  from  the  standard  normal 
reference  distribution.  Also,  let  m,:„  =  E[Gi:n].  The  length  of  the  vector,  a„  is 
obtained  from  the  magnitude  of  the  standardized  sample  order  statistic,  while  its 
orientation  9,  is  related  to  m,:„.  More  specifically,  by  definition. 


9i  =  7r$(m,:„) 

where  $(x)  =  exp{—^)di  is  the  cumulative  distribution  function  of  the 

standard  Gaussian  distribution.  We  define  the  sample  points  in  a  two  dimensional 
plane  by 

Qk  =  {Uk,Vk)  A:  =  l,2,...n  (5.8) 

where  f/o  =  Vq  =  0  and 

H  =  (5-9) 

fc  =  1,2,  ...n. 
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The  sample  linked  vectors  are  obtained  by  joining  the  points  Qk-  Note  that  Qo  = 
(0,0).  It  should  also  be  noted  that  the  statistic  Q„  given  in  eq  (5.8)  represents 
the  terminal  point  of  the  linked  vectors  defined  above.  Figure  5.1  shows  the  linked 
vectors  obtciined  for  the  Gaussian  distribution  with  n  =  6.  Since  [/„  and  Vn  are 
random  variables  for  a  given  n,  the  corresponding  linked  vectors  must  be  obtained 
by  averaging  the  results  of  Monte-Carlo  trials.  In  this  case  the  linked  vectors  were 
obtained  by  averaging  the  results  of  50,000  Monte  Carlo  trials.  The  solid  curve  in 
Figure  5.1  shows  the  linked  vectors  for  the  sample  distribution  while  the  dashed  curve 
shows  the  ideal  linked  vectors  for  the  null  distribution.  The  magnitudes  and  angles  of 
the  linked  vectors  are  obtained  from  eq  (5.7).  Note  that  the  angles  are  independent  of 
the  data.  Only  the  magnitudes  of  the  linked  vectors  change  from  one  trial  to  another. 

For  a  typical  set  of  ordered  samples  (i.e.,  ordered  samples  drawn  from  the  null 
distribution)  it  is  reasonable  to  expect  that  the  sample  linked  vectors  would  follow 
the  null  pattern  closely.  If  the  ordered  set  of  samples  is  not  from  the  null  distribution, 
the  sample  linked  vectors  are  not  expected  to  follow  the  null  pattern  closely.  Hence, 
the  procedure  provides  visual  information  about  how  well  the  ordered  set  of  samples 
fit  the  null  distribution. 

An  important  property  of  the  Qn  statistic  is  that  it  is  invariant  under  linear  trans¬ 
formation.  In  particular,  we  consider  the  standardization  used  in  eq  (5.5).  Let 
Zi  =  cXi  -|-  d,  where  c  and  d  axe  known  constants.  Let  S'  denote  the  sample  standard 
deviation  of  the  samples  Z,.  Then,  it  is  readily  shown  that  .  The 

invariance  property  follows  as  a  consequence.  The  advantage  of  this  property  is  that 
the  PDF  oi  Qn  =  {Un,  K),  for  a  given  sample  and  reference  distribution  depends  only 
on  the  sample  size  n  and  is  unaffected  by  the  location  and  scale  parameters.  Since 
it  is  difficult  to  determine  the  joint  PDF  of  and  14  analytically,  it  is  necessary  to 
obtain  empirical  results. 

Assuming  that  the  conditions  under  the  central  limit  theorem  are  satisfied,  the 
marginal  PDFs  of  t/„  and  14  can  be  approximated  as  Gaussian,  in  the  limit  of  large  n. 
In  addition,  it  is  assumed  that  the  joint  PDF  of  Un  and  14  is  approximately  bivariate 
Gaussian.  Consequently,  all  that  is  needed  to  determine  the  bivariate  PDF  is  the 
specification  of  E{Un),  E{Vn),  E{UnVn),  Var{Un)  and  V’ar(14).  Drawing  samples 
from  the  Gaussian  distribution,  it  has  been  shown  empirically  in  [41]  that  for  3  < 
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n  <  100 


E{Un)  =  0 


E{Vn)  =  /iv  «  0.326601  +  2^^ 

E{UnVn)  =  0  (5-10) 

Var{Un)  =  <rl^  +  2:^ 

Var{Vn)  =  al  «  2:2^  -  2:^. 

Since  Un  and  Vn  are  approximately  bivariate  Gaussian  for  large  or  moderate  sample 
sizes,  their  joint  PDF  can  be  written  as 


Un)  =  (27r)  exp{--) 


(5.11) 


where 


4  _  I  {Vn-fiy? 

t  r%  I  rt  ' 


(5.12) 


Let  t  =  to.  Then  the  equation 


Ul  , 

^0  o  ‘  o 


(5.13) 


is  that  of  an  ellipse  in  the  Un,  u„  plane  for  which 


fUn,Vn{un,  v„)  =  (27r)  T<T„a„)~  exp(-— ). 


(5.14) 


Points  that  fall  within  the  ellipse  correspond  to  those  points  in  the  Un,Vn  plane  for 


which 


f[/n,vju„,  v„)  >  (2t)  ^(o-uar^y^xpi-j). 


(5.15) 


a  =  P{T  >  to)  =  P*(«n)  fall  outside  the  ellipse  given  by  eq  (5.13)).  (5.16) 

It  is  well  known  that  the  PDF  of  the  random  variable  T  defined  by  eq  (5.12)  has  a 
Chi-Square  distribution  with  two  degrees  of  freedom  [45]  and  is  given  by 


/r(t)  =  0.5exp(--). 


(5.17) 


Hence, 


a  =  1  -  exp{-^). 


Consequently,  to  =  — 2/n(l  —  a).  Thus,  eq  (5.13)  becomes 

4  +  = -2/n(l  -  a). 


(5.18) 


(5.19) 


Q  is  known  as  the  significance  level  of  the  test.  It  is  the  probability  that  Qn  falls 
outside  the  ellipse  specified  by  eq  (5.19)  given  that  the  data  is  coming  from  a  Gaussian 
distribution.  1  -  a  is  known  as  the  confidence  level  and  the  corresponding  ellipse  is 
known  as  the  confidence  ellipse. 

Eq  (5.13)  can  be  written  in  the  standardized  form 


fL  4. 

o  I 


(5.20) 


where  the  lengths  of  the  major  and  minor  axes  are  given  by  2max  [cr„v^, 
and 

2mm  [<Tuv/^,  <Tyy/Q  ,  respectively.  From  eq  (5.18),  observe  that  smaller  values  of  a 
correspond  to  larger  values  of  to-  Consequently,  the  confidence  ellipses  become  larger 
as  the  confidence  level  is  increased. 

For  a  given  sample  size  n  (n  <  100)  approximate  values  of  and  cr^  can  be 

obtained  from  eq  (5.10).  The  confidence  ellipse  of  eq  (5.19)  can  then  be  used  to  make 
a  visual  as  well  as  computational  test  of  the  null  hypothesis.  If  the  terminal  sample 
point  falls  inside  the  ellipse,  then  the  data  is  declared  as  being  consistent  with  the 
Gaussian  distribution  with  confidence  level  1  —  a.  Otherwise  the  null  hypothesis  is 
rejected  with  a  significance  level  a. 

A  major  difficulty  in  determining  the  joint  PDF  of  Un  and  14  is  that  the  coefficients 
of  skewness  and  kurtosis  of  Un  aud  14  (see  Table  5.3)  indicate  that  the  Gaussian  ap¬ 
proximation  for  the  bivariate  PDF  may  not  be  satisfactory  for  n  <  10.  The  empirical 
bivariate  PDF  of  U  and  V  were  obtained  by  using  50,000  Monte-Carlo  trials  for  n=3, 
10,  20,30,  50  and  100.  The  corresponding  constant  probability  contours  of  the  joint 
PDF  of  Un  and  14  are  shown  in  Figure  5.2.  The  same  procedure  is  used  even  when 
the  null  distribution  is  different  from  the  Gaussian  distribution.  However,  note  that 
the  standard  Gaussian  distribution  is  always  used  as  the  reference  distribution  for 
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determining  the  angles  of  the  linked  vectors. 

5.4  Distribution  Approximation 

In  this  section  we  present  a  graphical  procedure  for  approximating  the  underlying 
PDF  of  a  set  of  random  data  based  on  the  goodness-of-fit  test  procedure  discussed  in 
section  5.3. 

Following  a  similar  approach  to  that  outlined  in  section  5.3,  random  samples  axe 
generated  from  many  different  univariate  probability  distributions.  For  each  specified 
distribution  and  for  a  given  n,  the  statistic  Q„  =  (f/„,  14)  given  by  eq  (5.9)  is  obtained 
for  various  choices  of  the  shape  parameter.  Thus,  each  distribution  is  represented  by  a 
trajectory  in  the  two  dimensional  plane  whose  coordinates  are  and  Figure  5.3 
shows  an  example  of  such  a  representation.  Twelve  distributions  namely  Gaussian 
(1),  Uniform  (2),  Exponential  (3),  Laplace  (4),  Logistic  (5),  Cauchy  (6),  Extreme 
Value  (7),  Gumbel  type-2  (8),  Gamma  (9),  Pareto  (10),  Weibull  (11)  and  Lognormal 
(12)  are  represented  in  this  chart.  Tables  5.1  and  5.2  show  the  standard  form  and  the 
general  form  respectively,  of  the  PDFs  represented  in  the  identification  chart.  The 
value  of  Qn  at  each  point  of  the  trajectories  is  obtained  by  Monte-Carlo  experiments 
using  the  standard  Gaussian  distribution  as  the  reference  distribution  for  determining 
the  angles  The  results  are  based  on  averaging  1000  trials  of  n  =  50  samples  from 
each  distribution.  The  samples  from  each  distribution  are  obtained  by  using  the 
IMSL  subroutines  for  specified  values  of  the  shape  parameter.  Since  the  procedure 
is  location  and  scale  invariant,  the  trajectory  reduces  to  a  single  point  for  those 
PDFs  which  do  not  have  shape  parameters  but  are  characterized  only  in  terms  of 
their  location  and  scale  parameters.  By  way  of  example,  the  Gaussian,  Laplace, 
Exponential,  Uniform  and  Cauchy  PDFs  are  represented  by  single  points  in  the  Un  — 
14  plane.  However,  those  PDFs  which  have  shape  parameters  are  represented  by 
trajectories.  For  a  given  value  of  the  shape  parameter,  a  single  point  is  obtained  in 
the  Un  —  Vn  plane.  By  varying  the  shape  parameter,  isolated  points  are  determined 
along  the  trajectory.  The  trajectory  for  the  PDF  is  obtained  by  joining  these  points. 
In  a  sense  the  trajectory  represents  a  family  of  PDFs  having  the  same  distribution 
but  with  different  shape  parameter  values.  For  example,  the  trajectory  corresponding 
to  the  Gamma  distribution  in  Figure  5.3  is  obtained  by  joining  the  points  for  which 
the  shape  parameters  are  0.2,  0.3,  0.5,  0.7,  1.0,  2.0,  3.0,  4.0,  6.0,  10.0.  As  the  shape 
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parameter  increases,  note  that  the  Gamma  distribution  approaches  the  Gaussian 
distribution.  The  representation  of  Figure  5.3  is  called  an  identification  chaurt.  Some 
distributions  such  as  the  0  distribution  and  the  SU-Johnson  system  of  distributions, 
have  two  shape  parameters.  For  these  cases,  the  trajectories  are  obtained  by  holding 
one  shape  parameter  fixed  while  the  other  is  varied.  For  these  distributions,  several 
different  trajectories  are  generated  in  order  to  cover  as  much  of  the  Un  —  Vn  plane 
as  possible.  For  certaiin  choices  of  the  shape  parameters,  two  or  more  PDFs  become 
identical.  When  this  occurs,  their  trajectories  intersect  on  the  identification  chart. 

It  is  apparent  that  the  identification  chart  of  Figure  5.3  provides  a  one  to  one 
graphical  representation  for  each  PDF  for  a  given  n.  Therefore,  every  point  in  the 
identification  chart  corresponds  to  a  specific  distribution.  Thus,  if  the  null  hypothesis 
in  the  goodness-of-fit  test  discussed  in  section  5.3  is  rejected,  then  the  distribution 
which  approximates  the  underlying  PDF  of  the  set  of  random  data  can  be  obtained 
by  comparing  Q„  obtciined  for  the  samples  with  the  existing  trajectories  in  the  chart. 
The  closest  point  or  trajectory  to  the  sample  Qn  is  chosen  as  an  approximation  to  the 
PDF  underlying  the  random  data.  The  closest  point  or  trajectory  to  the  sample  point 
is  determined  by  projecting  the  sample  point  to  neighboring  points  or  trajectories 
on  the  chart  and  considering  that  point  or  trajectory  whose  perpendicular  distance 
from  the  sample  point  is  the  smallest.  Consider  the  situation  of  Figure  5.4.  Let 
denote  the  coordinates  of  the  sample  point.  Let  Xi,  yi  and  X2>  ^2 
denote  the  coordinates  of  the  points  A  and  B  on  the  trajectory  shown  in  Figure  5.4. 
It  is  assumed  that  segment  of  the  trajectory  between  the  points  A  and  B  is  linear.  Let 
xo,  yo  denote  the  coordinates  of  the  point  of  intersection  of  the  straight  line  between 
A  and  B  and  the  projection  of  Qn  =  onto  this  straight  line.  The  equation  of 

the  straight  line  between  the  points  A  and  B  can  be  written  eis 

y -t/i  =  m(x  -  Xi)  (5.21) 

where  m  =  ^  •  Also,  the  equation  of  the  straight  line  joining  xq,  yo  and  {u\v) 

is 

=  _i.(x  -  «').  (5.22) 

m 

The  coordinates  xo,  yo  result  from  the  solution  of  eqs  (5.21)  and  (5.22)  and  are  given 


121 


by 


yo  -  ;;rfH  [yi  “  ^ 

Finally,  the  perpendicular  distance  from  the  sample  point  onto  the  trajectory  between 
the  points  A  emd  B  is 

D  =  ^^^/^i)KC?-2mC.C2  +  C|]  (5.24) 

where 

Cl  =  «'  - 

C2  =  u'  -  yi. 

The  complete  approximation  ailgorithm  is  summarized  as  follows. 

1.  Sort  the  samples  Xi^X^,. .  .Xn  in  increasing  order. 

2.  Obtain  the  sttindardized  order  statistic  Yi:n. 

3.  Compute  Un  and  K  from  eq  (5.9). 

4.  Obtain  an  identification  ch<irt  based  on  the  sample  size  n  and  plot  the 
sample  point  Qn  on  this  chart. 

5.  Compute  D  using  the  sample  point  Qn  and  the  existing  distributions 
on  the  chart.  Choose  the  PDF  corresponding  to  the  point  or  trajectory 
that  results  in  the  smallest  value  of  Z?  as  an  approximation  to  the  PDF 
of  the  samples. 

The  approximation  to  the  underlying  PDF  of  the  set  of  random  data  can  be  im¬ 
proved  by  including  as  many  distributions  as  possible  in  the  identification  chart  so 
as  to  fill  as  much  of  the  space  as  possible  with  candidate  distributions.  However,  it 
is  emphasized  that  this  procedure  does  not  identify  the  underlying  PDF.  Rather  it 
identifies  a  suitable  approximation  to  the  underlying  PDF. 

5.5  Parameter  Estimation 

Once  the  probability  distribution  of  the  samples  is  approximated,  the  next  step  is 
to  estimate  its  parameters.  The  method  discussed  in  section  5.4  lends  itself  for  esti- 
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mating  the  parameters  of  the  approximated  distribution.  We  present  the  estimation 

procedure  for  the  location,  scale  and  shape  parameters  in  this  section. 

5.5.1  Estimation  of  Location  and  Scale  Parameters 

Let  /(x;a,  ^,)  denote  a  known  distribution  which  approximates  the  PDF  of  the 
set  of  random  data,  where  oc  and  0  are  the  location  parameter  and  scale  parameter, 
respectively,  of  the  approximating  PDF.  Let  Xi-.n  denote  the  ordered  statistics  of  X 
from  a  sample  of  size  n.  A  standcirdized  ordered  statistic  is  defined  by 


W.:„  = 


Xiiji  QJ 


(5.26) 


=  E[W,.r.]. 


(5.27) 


Then 


E[Xi..„]  =  I3fli:n  +  OC 


(5.28) 


We  consider  the  following  statistics 


Ti  =  Er  Cos{9i)Xi..r. 
T2  =  Er  Sin{ei)Xi..n 


(5.29) 


where  6i  is  the  angle  defined  in  eq  (5.7).  The  expected  values  of  T\  and  T2  are 


E[Tr]  =  Y:^  Cos{ei)[0fii..n  +  cc] 
E[T2]  =  Y:':  Sin{0,)[l3^i..n  +  cc]. 


(5.30) 


These  can  be  written  as 


E{Tx)  =aa  +  bl3 
EiT-i)  =  ccx  + 


(5.31) 
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where 


a  =  UCos{ei) 

6  =  Er/i.:nC05(^.) 

(5.32) 

c  =  Sin{6i) 
d  =  T!-  lii-.nSin{di). 

Because  the  stajidardized  Gaussian  distribution  is  used  as  the  refernce  distribution 
for  it  follows  that  a  =  0  [41].  The  estimates  for  jS  and  a  are  then  given  by 


Q  =  m]-do 


(5.33) 


where  the  symbol  A  is  used  to  denote  an  estimate.  For  n  sufficiently  large  (i.e., 
n  >  50),  suitable  estimates  for  E[Ti]  and  E[T2]  are 


MTi]  =  Ti 

(5.34) 

E[T2]  =  T2. 

Estimates  for  b  and  d  rely  upon  an  estimate  of  /i,;„  is  obtained  from  a  Monte 
Carlo  simulation  of  Wi-n  where  VF,;n  is  generated  from  the  known  approximating 
distribution  /(x;0, 1)  having  zero  location  and  unity  scale  parameters.  /i,:„  is  the 
sample  mean  of  VF,:„  based  upon  1000  Monte  Carlo  trials.  Having  /iim,  the  estimates 
for  b  and  d  are  given  by 

b=Z7idi:nCos{6i) 

(5.35) 

d  =  Hi  iii:nSin{6i). 

The  scale  and  location  parameters  are  then  estimated  by  application  of  eq  (5.33). 
5.5.2  Shape  Parameter  Estimation 

In  this  section  we  present  an  approximate  method  for  estimating  the  shape  pa¬ 
rameter  of  the  approximating  PDF.  This  procedure  can  be  used  only  when  the  ap¬ 
proximating  PDF  has  a  single  shape  parameter  to  be  determined.  Let  7  denote  the 
shape  parameter  of  the  approximating  PDF.  Since  Un  and  K,  are  location  and  scale 
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invariant,  the  point  Qn  depends  only  on  the  sample  size  n  and  the  shape  parameter 

7- 

Recall  that  the  trajectories  on  the  identification  chart  are  obtained  by  averaging 
the  results  of  a  large  number  of  trials  for  C/„  and  Vn-  Consequently,  for  a  given  value 
of  n,  the  coordinates  of  the  points  along  the  trajectory  for  a  specified  distribution 
and  can  be  characterized  by 


i:(V„)  =  <^2(n,7) 


(5.36) 


where  the  complete  trajectory  is  obtained  by  repeating  the  large  number  of  trials  over 
a  suitable  range  of  7.  On  a  given  trial  involving  the  random  data  it  is  likely  that  the 
coordinates  f/„  and  Vn  for  the  scimples  will  not  coincide  with  any  of  the  trajectories  on 
the  chart.  The  random  data  is  approximated  by  that  distribution  which  falls  closest 
to  the  sample  point  Qn-  The  situation  is  illustrated  in  Figure  5.7.  Trl  and  Tr2 
denote  the  trajectories  for  two  different  candidate  distributions  denoted  by  PDFl 
and  PDF2,  respectively.  Let  xq  denote  the  point  on  Trl  closest  to  Qn-  Assume  that 
the  linear  segment  of  Trl  on  which  xq  falls  was  drawn  between  the  points  (ui,  Vi)  and 
(u2,  V2).  Let  the  shape  parameter  values  corresponding  to  these  points  be  denoted  by 
7i  and  72,  respectively.  Then  the  value  of  the  shape  parameter  corresponding  to  the 
sample  point  Qn  is  obtained  by  linear  interpolation  and  is  given  by 


7  «  7i  + 


(72  -7i)(j^o  -  ^i) 

(u2  -  ui) 


(5.37) 


where 


(^+Tj 

A  _  ("a-t'i) 


(5.38) 


The  accuracy  of  the  procedure  can  be  improved  by  employing  a  non-linear  interpo¬ 
lation  method.  It  must  be  emphasized  that  the  location,  scale  and  shape  pairameter 
estimation  procedures  presented  in  this  section  are  approximate  procedures. 
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5.6  Assessing  the  Distributional  Properties  of  SIRVs 

A  random  vector  Y  =  [Vi,  Y2,  ...  is  a  spherically  invariant  random  vector 
(SIRV)  if  its  PDF  has  the  form 

/Y(y)  =  (27r)-^lSrU„(p)  (5.39) 

where  p  =  (y  —  p)'^S”^(y  —  p)  is  a  non-negative  quadratic  form,  p  and  S  are  the 
mean  vector  and  covariance  matrix,  respectively  of  Y  and  hN{p)  is  a  non-negative, 
monotonicaJly  decreasing,  real  valued  function  for  all  N. 

Recall  from  Chapter  3  that  the  PDF  of  the  quadratic  form  appearing  in  eq  (5.39) 
is  given  by 

fp{p)  =  ^E7:^^Nip)u{p)  (5.40) 

22r(f) 

where  r(a)  is  the  Eulero-Gamma  function  and  u{p)  is  the  unit  step  function.  It  was 
also  pointed  out  in  Chapter  3  that  the  PDF  of  the  quadratic  form  is  invariant  to  the 
choice  of  p  and  S.  For  example,  in  the  multivariate  Gaussian  case,  the  PDF  of  the 
quadratic  form  is  the  well  known  Chi-square  distribution  with  N  degrees  of  freedom. 
Therefore,  for  a  given  N,  the  SIRV  is  uniquely  characterized  by  the  quadratic  form. 
In  order  to  identify  the  PDF  of  the  underlying  SIRV  it  is  sufficient  to  identify  the  PDF 
of  the  quadratic  form.  This  attractive  property  of  SIRVs  enables  us  to  study  various 
distributional  aspects  of  the  corresponding  multivariate  samples.  When  a  radar  uses 
coherent  processing,  the  joint  PDF  of  the  2N  quadrature  components  is  of  interest. 
Eqs  (5.39)  and  (5.40)  are  then  applicable  with  N  replaced  by  2N. 

In  modeling  real  world  data,  the  first  step  is  to  determine  the  most  appropriate 
PDF  that  approximates  the  data.  In  the  univariate  case,  the  fit  and  assessment  of 
the  goodness  of  fit  for  various  distributions  has  been  studied  extensively  and  several 
methods  axe  available  for  this  purpose.  However,  limited  success  has  been  achieved 
for  the  multivariate  situation.  Although  a  number  of  multivariate  distributions  have 
been  developed,  the  multivariate  Gaussian  distribution  has  been  the  focus  of  much 
of  the  techniques  for  multivariate  analysis  [46]. 

Assessment  of  the  distributional  assumptions  for  multivariate  data  is  a  non  trivial 
problem.  Several  techniques  have  been  proposed  to  tissess  multivariate  Gaussianity. 
In  a  recent  paper  Ozturk  and  Romeu  [44]  give  a  review  of  the  methods  for  testing 
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multivariate  Gaussianity.  Mciny  of  these  methods  can  be  modified  or  generalized 
to  develop  goodness  of  fit  methods  for  SIRVs.  If  a  random  vector  Y  is  an  SIRV, 
then  the  corresponding  marginal  distributions  must  be  identical  (up  to  location  and 
scale  parameters).  Based  on  this  property,  one  cam  use  the  the  standard  univariate 
goodness  of  fit  testing  procedures  to  assess  the  degree  of  similarity  of  the  marginal 
distributions  of  the  multivariate  data.  However,  such  an  approach  does  not  provide 
a  way  to  aissess  the  joint  distribution  of  the  components  of  the  multivariate  sample. 

Since  SIRVs  can  be  uniquely  characterized  in  terms  of  the  quadratic  form  P, 
eq  (5.40)  provides  an  important  property  for  developing  goodness  of  fit  test  procedures 
for  SIRVs.  Specifically,  if  the  PDF  of  P  can  be  identified,  then  the  corresponding  PDF 
of  the  SIRV  can  also  be  identified.  In  fact,  many  tests  for  assessment  of  multivariate 
Gaussianity  are  based  on  the  use  of  this  quadratic  form  [47].  By  use  of  this  tech¬ 
nique,  note  that  the  multivariate  distribution  approximation  problem  is  reduced  to 
a  corresponding  univariate  distribution  approximation  of  the  quadratic  form.  Any 
of  the  classical  goodness  of  fit  testing  procedures  like  the  Kolmogorov- Smirnov  and 
Chi-Square  tests  can  be  used  to  address  the  problem  of  distribution  identification  of 
the  quadratic  form.  However,  the  requirement  of  large  sample  sizes  for  specifying  the 
parameters  of  the  distribution  and  low  power  of  the  test  necessitate  use  of  alternate 
procedures  that  are  more  efficient. 

A  general  algorithm  was  developed  in  [41]  to  test  for  univariate  and  multivariate 
normality  and  has  been  summarized  in  sections  5. 3-5. 5.  In  this  section  we  propose  the 
use  of  this  algorithm  for  performing  the  goodness  of  fit  test  for  SIRVs.  The  procedure 
is  summarized  here  for  completeness.  Let  Y  =  [Yi,  12 . . .  Yv]^  denote  a  vector  of 
observations.  For  each  observation  vector  of  size  N,  we  compute  the  corresponding 
quadratic  form  Pj,  (i  =  1, 2, ...  n)  where  the  maximum  likelihood  (ML)  estimates  of 
the  mean  vector  of  Y  and  its  covaxiance  matrix  are  used.  For  the  Gaussian  Ccise,  it  is 
well  known  that  these  ML  estimates  are  the  sample  mean  and  the  sample  covariance 
matrix,  respectively  [48].  In  Appendix  C,  it  is  shown  that  the  same  results  hold 
for  SIRVs  [49].  Our  goal  is  to  test  whether  p,  {i  =  1,2, ...n)  are  samples  from  a 
certain  distribution  P(p;a, /9,7)  where  a,  /3  are  the  location  and  scale  parameters, 
respectively  and  7  is  the  shape  parameter. 

Let  Pi:„  <  P2;n  <  . . .  <  Pn:n  denote  the  ordered  observations  of  the  quadratic 
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form  Pi  (t  =  1,  2,  . .  .n).  We  define  the  standardized  sample  order  statistic  as 


(5.41) 

bp 

where  P  and  Sp  are  the  sample  mean  and  sample  standard  deviation,  respectively. 
Corresponding  to  the  sample  order  statistics  i?i:„  through  the  point  Qi  = 
{Ui,  Vi)  is  defined  where 


Ui 

Vi 

where  $(.)  and  mj.,n  were  defined  in  Section  5.3. 

For  a  given  set  of  n  multivariate  samples,  the  points  Qi  {i  =  1,  2, . . .  n)  are  plotted 
and  joined  to  obtain  a  linked  vector  chart.  The  linked  vectors  under  the  null  hypoth¬ 
esis  are  obtained  by  averaging  the  results  of  50,000  Monte  Carlo  trials  from  the  PDF 
of  the  quadratic  form  given  by  eq  (5.40).  The  proposed  test  is  based  on  comparing 
the  sample  and  the  null  linked  vectors.  If  the  null  hypothesis  is  true,  then  we  expect 
that  the  sample  linked  vectors  will  follow  the  null  linked  vectors  closely. 

Finally,  a  formal  goodness  of  fit  test  is  performed  using  the  terminal  point  of  the 
null  linked  vectors  (i.e  Qn  =  {Un,  Ki))-  Using  the  centred  limit  theorem,  as  outlined  in 
section  5.3,  confidence  ellipses  centered  at  Qn  for  the  null  linked  vectors  are  obtained. 
If  the  terminal  point  of  the  sample  linked  vectors  does  not  fall  inside  the  100(1  —  a)% 
confidence  ellipse,  then  the  corresponding  null  hypothesis  is  rejected  at  the  a  level  of 
significajice.  Note  that  the  Qn  test  provides  an  interesting  graphical  representation 
of  the  data.  An  example  of  such  a  graphical  representation  is  given  in  Fig  5.5  for 
testing  a  multivariate  Gaussian  distribution  with  n  =  50  and  =  4. 

It  should  be  noted  that  the  statistic  is  location  and  scale  invariant.  In  other 
words  it  is  independent  of  the  location  and  scale  pairameters.  However,  it  depends 
on  the  shape  parameter  of  the  null  distribution.  Assessment  of  the  distributional 
assumptions  of  distributions  that  have  shape  parzimeters  is  conceptually  different 
from  those  that  do  not.  In  the  former  case,  we  test  whether  the  sample  comes  from  a 
family  of  distributions  while  in  the  latter  case,  we  test  for  a  simple  distribution.  One 
possibility  for  dealing  with  this  problem  is  to  specify  the  value  of  the  shape  pareuneter 


7  Ej=i  cos{7r$(mj;„)}|i2j:n| 
7  Ei=i  5m{7r$(mj:„)}li?j:„| 


(5.42) 
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and  perform  the  test  in  the  usual  way.  If  the  shape  parameter  cannot  be  specified, 
then  an  adaptive  approach  which  uses  a  sample  estimate  of  the  shape  parameter  must 
be  employed. 

Advantages  of  using  the  Qn  procedure  are  explained  in  [41].  Usually  the  classical 
goodness  of  fit  tests  end  up  with  either  rejecting  or  accepting  the  null  hypothesis. 
An  attractive  property  of  the  Qn  procedure  is  that  it  provides  some  information 
about  the  true  distributions  if  the  null  hypothesis  is  rejected.  Using  this  property  an 
ailgorithm  for  characterizing  and  identifying  the  distributions  can  be  developed.  The 
next  section  explains  these  ideas. 

5.7  Distribution  Identification  of  SIRVs 

Following  the  same  procedure  described  in  Section  5.4,  where  the  reference  distri¬ 
bution  was  Gaussian,  an  identification  chart  can  be  generated  for  each  of  quadratic 
form  PDFs  of  the  SIRVs  listed  in  Tables  5.3  and  5.4.  Recall  from  Chapter  3  that 
the  PDF  of  the  quadratic  form  is  invariant  to  the  choice  of  n  and  S.  Hence,  for 
simplicity,  the  trajectories  for  the  PDFs  of  the  quadratic  forms  of  the  SIRVs  listed 
in  Tables  5.1  and  5.2  are  obtained  by  generating  the  SIRVs  having  zero  mean  and 
identity  covariance  matrix.  Each  point  on  a  trajectory  is  obtained  by  averaging  the 
results  of  2000  Monte  Carlo  trials  of  size  n  =  100.  As  before,  PDFs  which  do  not 
have  shape  parameters  are  represented  by  a  single  point  in  the  U-V  plane  while  those 
which  have  shape  parameters  generate  a  trajectory  in  the  U-V  plane  by  changing  the 
shape  parameter. 

Assuming  coherent  radar  processing,  Table  5.3  and  Table  5.4  provide  a  library  of 
^2n(p)  for  various  multivariate  SIRV  PDFs.  An  example  of  the  identification  chart  is 
given  in  Fig  5.6  for  =  4  and  n  =  50  where  the  expected  values  of  Qn  =  {Un,  Vn)  is 
plotted  for  various  distributions.  The  Gaussian  distribution  was  used  as  the  reference 
distribution.  The  SIRVs  listed  in  Table  5.1  and  Table  5.2  are  included  in  the  chart 
and  labeled  by  number.  It  is  noted  that  the  multivariate  Gaussian  (1),  Laplace  (2) 
and  Cauchy  (3)  distributions  are  represented  by  single  points  on  the  chart  while  the 
multivariate  K-distribution  (8),  Chi  (9),  Generalized  Rayleigh  (10)  WeibuU  (11)  and 
Rician  (12)  are  represented  by  trajectories.  The  Student-t  distribution  (4,  5,  6,  7) 
with  degrees  of  freedom  3,  5,  10  and  15,  respectively,  is  also  shown  in  the  chart.  The 
trajectories  for  each  distribution  were  obtained  by  joining  10  points  resulting  from  the 
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use  of  the  distributions  with  parameter  values  listed  in  Table  5.3.  Each  point  in  the 
chart  is  obtained  by  simulating  2000  samples  from  the  corresponding  distributions. 
The  methods  developed  by  Rangaswamy  et  al.  [22,  50]  were  used  to  generate  the 
multivariate  samples. 

The  identification  chart  provides  an  interesting  display  for  identifying  and  charac¬ 
terizing  the  distributions.  Also,  relationshipe  between  the  various  distributions  are 
clearly  seen.  For  example,  as  their  parameters  axe  varied,  certain  distributions  ap¬ 
proach  the  multivariate  Gaussian  distribution.  Also,  for  appropriately  chosen  param¬ 
eters,  the  multivariate  Weibull  distribution  and  the  Generalized  Rayleigh  distribution 
cam  be  seen  to  coincide.  For  a  given  N-variate  sample  of  size  n,  the  statistic  Qn  based 
on  the  sample  quadratic  forms  can  be  computed  and  plotted  on  the  identification 
chart.  Then  the  nearest  distribution  to  the  sample  point  is  identified  to  be  the  best 
candidate  for  the  underlying  true  distribution  of  the  data.  An  example  of  such  an 
identification  is  shown  in  Figure  5.6  where  a  well  known  data  set  (i.e.  Iris  Setosa  [51]) 
is  used  to  obtain  a  value  for  Qn  and  is  denoted  by  the  point  S.  The  Iris  Setosa  data 
consists  of  four  measurements  taken  from  50  plants.  It  is  seen  from  Figure  5.6  that 
the  best  candidate  for  approximating  the  data  is  the  multivariate  Chi(9)  distribution. 

We  point  out  that  there  are  other  methods  which  can  be  used  for  the  distribution 
identification  problem.  A  commonly  used  technique  is  the  Q  —  Q  plot.  To  identify 
the  underlying  distribution  the  sample  quantiles  are  plotted  against  the  expected 
quantiles  of  a  reference  distribution.  Then  the  resulting  shape  of  the  plotted  curve  is 
taken  as  a  basis  for  identifying  the  corresponding  candidate  for  the  true  distributions. 
However,  the  identification  is  made  on  a  subjective  basis.  Even  then  the  procedure  is 
not  very  easy.  Another  well  known  approach  for  distinguishing  between  distribution 
is  to  characterize  them  via  their  skewness  (03)  and  kurtosis  (04)  coefficients.  In  this 
case,  all  the  distributions  are  represented  by  points  on  the  Q3-  Q4  plane  and  the  sample 
data  point  is  compared  with  the  points  representing  the  theoretical  distributions  in 
the  same  way  as  in  the  Qn  procedure.  However,  estimates  of  03  and  04  are  known 
to  be  highly  sensitive  to  extreme  observations  and  therefore,  large  sample  sizes  are 
necessary  to  perform  the  identification  for  a  given  degree  of  accuracy. 
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5.8  Parameter  Estimation 

It  is  well  known  that  the  maximum  likelihood  estimate  of  the  covariance  matrix  of 
a  Gaussian  random  vector  is  the  sample  covariance  matrix.  Interestingly  enough,  it 
has  been  shown  in  [49]that  the  maximum  likelihood  estimate  of  the  covaxiance  matrix 
E  for  SIRVs  is  the  same  sample  covariance  matrix  used  in  the  Gaussian  case.  From 
eq  (5.40),  it  is  clear  that  the  expected  value  of  the  quaxiratic  form  can  be  expressed 
as 

E[P]=^iN,^)  (5.43) 

where  7  is  the  shape  parameter  of  the  distribution.  For  those  SIRVs  where  c^(.)  can 
be  evaluated  in  closed  form  and  is  invertible,  the  sample  mean  of  P,  denoted  by  P 
can  be  used  to  estimate  the  shape  parameter  according  to 

^  =  (5.44) 


where  P  =  Pi-  For  example,  in  case  of  the  K-distribution,  we  have  E[P]  = 

2aN  where  q  is  the  shape  parameter  of  the  K-distribution.  Clearly,  the  shape  pa¬ 
rameter  is  given  by  d  =  ^.  Unfortunately,  it  is  not  always  possible  to  obtain  an 
invertible  closed  form  expression  for  (^(-l  O-  The  shape  parameter  estimation  pro¬ 
cedure  suggested  here  is  not  suitable  in  such  a  case.  An  alternate  method  for  the 
parameter  estimation  problem  is  then  needed. 

In  this  section  we  propose  to  use  the  Qn  statistic  to  obtain  an  approximate  esti¬ 
mator  for  the  shape  parameter.  The  underlying  procedure  is  explained  in  [41]  and 
is  summarized  here.  Let  the  points  (Pi,Vi)  and  {U21V2)  denote  the  coordinates  of 
Qn  corresponding  to  parameters  71  and  72  respectively,  of  a  given  SIRV.  Suppose 
these  points  are  the  nearest  points,  on  the  trajectory  for  the  identified  distribution 
to  the  sample  point  Qn  =  (U„,K,)  corresponding  to  the  data.  Then  by  using  linear 
interpolation,  aji  approximate  estimator  of  7  is  given  by 


7«7i  + 


(72  -7i)(a^o-  ^1) 
{U2  -  U,) 


(5.45) 


131 


Table  5.1;  Table  of  Standard  Forms  of  Univariate  PDFs  Used  For  Identification  Chart  of 
Figure  5^3 _ 


Distribution 

Standard  Form  /y(y) 

Gaussian 

(>/2jr)“^ezp(-!(^)  -oo<y<oo 

Uniform 

1  0<  y<  1 

Exponential 

eip(-y)  (0  <  y  <  oo) 

Laplace 

0.5exp(— |y|)  —  oo  <  y  <  oo 

Logistic 

eip(-y)[l  -1-  eip(-y)]"^  -  oo  <  y  <  oo 

Cauchy 

TTliTTi  oo<y<oo 

Extreme  Value  (Type  1) 

czp(-y)ezp[-€ip(-y)]  -  oo  <  y  <  oo 

Gumbel  (Type  2) 

7yexp(-7  -  l)eip(-y“'')  -  oo  <  y  <  oo 

Gamma 

y7^eip(-y)y^"‘  0  <  y  <  oo 

Pareto 

y  >  1,  7  >  0 

Weibull 

-(y>~^exTp{-y>)  y>0 

Lognormal 

^exp[  y  >  0 

where 

-  _  iA(Vn-V,)+A^Ui+U„} 

^0  -  (TO) 


_  (Vb-Vi) 
~  (t/a- 


(5.46) 


The  accuracy  of  the  proposed  estimator  for  7  depends  on  the  distance  between  the 
sample  point  Qn  and  the  corresponding  curve.  If  necessary,  the  approximation  can 
be  improved  by  using  non-linear  interpolation  methods. 


5.9  Conclusions 

In  this  Chapter  we  have  addressed  the  problem  of  distribution  identification  of  radar 
clutter  under  the  assumption  that  the  clutter  can  be  characterized  as  a  SIRP.  First  and 
foremost,  we  have  shown  that  the  multivariate  distribution  identification  problem  for 
SIRPs  can  be  reduced  to  an  equivalent  univariate  distribution  identification  problem 
of  a  non-negative  quadratic  form,  resulting  in  considerable  processing  simplicity.  A 
new  algorithm  which  provides  a  graphical  representation  for  the  goodness  of  fit  test 
and  the  distribution  identification  has  been  used.  This  algorithm,  while  conceptually 
simple,  is  extremely  efficient  while  dealing  with  small  sample  sizes.  Therefore,  it  is 
suitable  for  use  in  a  variety  of  practical  applications.  Finally,  based  on  this  algorithm, 
a  new  approach  has  been  proposed  for  estimating  the  shape  parameter  of  SIRPs. 
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Table  5.2:  Table  of  General  Form  of  Univariate  PDFs  Used  For  Identification  Chart  of 
Figure  5.3  _ 


II 


Distribution 


Gaussian 


Uniform 


Exponential 


Laplace 


Logistic 


Cauchy 


General  Form  fx{x) _ 


(v^^)"^€gp(- -oo  <  X  <  oo 


a<x  <  a-f /? 


)  a  <  X  <  00 


—  oo  <  X  <  oo 


—  OO  <  X  <  oo 


-  oo  <  X  <  oo 


}]  —  oo  <  X  <  oo 


Extreme  Vdue  (Type  1) 


Gumbel  (Type  2)  J^^^^cxp(— 7  —  l)exp[— — ]  —  00  <  x  <  00 


Gamma  ]  ^  a  <  x  <  00 


Pareto 


Weibull  I  i(^r"^expH^r]  ^  « 


Lognormal 


Table  5,4:  SIRVs  obtained  from  the  marginal  envelope  PDF 


Marginal  PDF  |  /i27v(p) 


(-2)^-M  E*=i  G*p"-*exp(-Bp) 

^‘  =  (  ^^1^) 

B  =  6V2 
i/<l 


Weibull 


Ek=iCkP^-^exp{-Api) 

A  =  oo-* 

c.=EL.(-ir*''2''#(  ‘ ) 


1  riO 
r(i/-t+i) 


r(i+^) 

r(i+i^-N) 


Gen.  Rayleigh  |  E*=i 

A  —  -2i“ 

^ 

B  = 

o*  =  EL.(-ir-"''-'2''-'!f(  * ) 

a  <  2 


r(i+i!^) 

r(2+^-N) 


Rician 
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Table  5.5:  SIRVs  obtained  from  the  marginal  characteristic  function 


Marginal  PDF 

hiffip) 

Gaussian 

exp(-^) 

Laplace 

mmmstamissM 

Cauchy 

■  iiiiiii  1 1^— 1 

K-distribution 

Student-t 

Table  5.6:  Shape  Parameters  of  the  SIRVs  Used  for  the  Identification  Chart 


K-Distribution 

0.1,  0.2,  0.3,  0.4,  0.5,  0.7,  0.9,  1.1,  1.5,  1.9 

Chi 

0.15,  0.2,  0.25,  0.3,  0.35,  0.4,  0.5,  0.6,  0.75,  0.95 

Gen.  Rayleigh 

0.2,  0.3,  0.4,  0.5,  0.6,  0.7,  0.8,  1.0,  1.5,  2.0 

Weibull 

0.3,  0.4,  0.6,  0.8,  1.0,  1.2,  1.4,  1.6,  1.8,  2.0 

Rician 

0.15,  0.2,  0.3,  0.4,  0.5,  0.6,  0.7,  0.8,  0.85,  0.9 

V 

0.6^ 
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T — r 
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Figure  5.3:  Identification  Chart  for  Univariate  Distributions  Based  on  1000  samples  (n=50);  Bl-B5=Beta, 
J1-J9=SU  Johnson,  G=Gamma,  W=Weibull,  K=K-distribution,  P=Pareto,  i=Log-normal,  T=Gumbel, 
E=  Exponential,  V=Extreme  Value,  A=Laplace,  L=Logistic,  U=Uniform,  N=Normal,  C=Cauchy 
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V 
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Figure  5.5:  Goodness  of  Fit  Test  for  SIRVs  using  the  Qn  Procedure.  90,  95  and  99% 
contours  for  the  Gaussian  distribution.  Broken  Line  =  Null  distribution  Pattern 
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Chapter  6 
Conclusions 


6.1  General  Remarks 

We  present  conclusions  and  suggestions  for  future  work  in  this  Chapter.  We  have 
addressed  the  problem  of  modeling,  simulation  and  distribution  identification  (mul¬ 
tivariate)  of  correlated  non-Gaussian  radar  clutter  that  can  be  characterized  as  a 
spherically  invariant  random  process  (SIRP).  The  SIRP  model  for  the  clutter  be¬ 
longs  to  the  class  of  exogenous  product  models,  where  the  clutter  process  can  be 
decomposed  as  a  product  of  two  independent  random  processes.  One  of  the  pro¬ 
cesses  is  Gaussian  while  the  other  is  a  highly  correlated  non-Gaussian  process,  which 
modulates  the  Gaussian  process.  The  SIRP  model  arises  as  a  special  case  when  the 
modulating  process  is  a  non-negative  random  variable.  This  in  turn,  imposes  the  re¬ 
quirement  that  the  modulating  random  process  have  a  decorrelation  time  much  larger 
than  that  of  the  Gaussian  process,  so  that  the  modulating  process  is  approximately 
constant  in  a  given  time  observation  interval. 

For  example,  consider  a  high  resolution  airborne  radar  operating  in  a  maritime  en¬ 
vironment  at  low  grcLzing  angles.  The  overall  sea  clutter  return  is  composed  of  returns 
from  the  capillary  waves  and  the  gravity  waves.  The  capillary  waves  correspond  to 
a  rapidly  time  variant  process.  It  has  been  pointed  out  in  [19]  that  the  returns  from 
the  capillary  waves  can  be  approximated  as  being  jointly  Gaussian.  Therefore,  the 
returns  from  the  the  capillary  waves  can  be  modeled  by  a  Gaussian  random  process. 
The  gravity  waves  correspond  to  a  slowly  time  variant  phenomenon.  Furthermore, 
it  has  been  shown  in  [19,  3,  7]  that  the  decorrelation  time  of  the  slowly  time  vari¬ 
ant  process  is  much  larger  than  that  of  the  Gaussian  process.  Consequently,  the 
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slowly  time  vaxieint  process  can  be  approximated  by  a  non-negative  random  variable. 
Hence,  the  SIRP  model  is  applicable  in  this  case.  In  fact,  if  the  non-negative  random 
variable  has  a  Chi-distribution,  the  overall  sea  clutter  returns  are  characterized  by 
a  K-distribution.  We  have  pointed  out  that  the  K-distribution  is  a  member  of  the 
family  of  SIRPs.  Therefore,  for  this  case,  the  SIRP  characterization  enables  us  to 
determine  the  optimal  radar  signal  processor.  The  validity  of  other  SIRPs  as  models 
for  radar  clutter  must  be  determined  through  an  experimental  effort. 

This  dissertation  has  made  the  following  significant  original  contributions. 

1.  Application  of  the  theory  of  SIRP  to  obtain  a  library  of  multivariate 
PDFs  of  correlated  non-Gaussian  random  vectors. 

2.  Derivation  of  the  result  that  an  SIRV  is  uniquely  characterized  through 
the  knowledge  of  the  PDF  of  a  quadratic  form. 

3.  Development  of  elegant  and  powerful  simulation  procedures  for  com¬ 
puter  generation  of  SIRVs. 

4.  Reduction  of  the  distribution  identification  for  SIRVs  from  a  multi¬ 
variate  problem  to  an  equivalent  univariate  distribution  identification 
problem. 

As  a  result  of  these  contributions,  the  problem  of  modeling,  simulation  and  distri¬ 
bution  identification  for  SIRVs  hcis  resulted  in  tremendous  computational  simplicity. 
Consequently,  the  schemes  developed  here  are  suitable  for  use  in  several  practical 
applications. 

6.2  Suggestions  for  Future  Research 

It  has  been  pointed  out  in  this  work  that  many  of  the  attractive  properties  of  Gaus¬ 
sian  random  processes  also  apply  to  SIRPs.  Consequently,  the  use  of  SIRPs  provides 
a  convenient  vehicle  for  solving  several  signal  detection  and  estimation  problems  in¬ 
volving  correlated  non-Gaussian  processes.  In  particular,  the  following  issues  may  be 
addressed  m  extensions  of  this  work. 

1,  Use  of  experimental  data  to  determine  the  applicability  of  the  SIRP 
model  for  modeling  clutter  in  radar,  sonar  and  image  processing. 


142 


2.  Application  of  the  Kalman  filter  for  SIRPs. 

3.  Use  of  SIRPs  for  radar  ambiguity  function  analysis. 

4.  Application  of  SIRPs  for  canceling  interference  in  digital  communica¬ 
tions. 

5.  Use  of  SIRPs  in  innovations  based  multich2mnel  detection  2ind  estima¬ 
tion. 

6.  Use  of  SIRPs  in  linear  predictive  coding  for  speech  processing. 

7.  Use  of  neurcd  networks  for  identifying  SIRPs. 

8.  Information  theoretic  considerations,  such  as  channel  capacity  and  rate 
distortion  theory,  for  SIRPs. 

9.  Use  of  SIRPs  in  parameter  estimation  involving  the  log  likelihood  func¬ 
tion. 


143 


Appendix  A 

Properties  of  SIRVs 


In  this  appendix  we  present  some  original  proofs  for  properties  of  SIRPs  stated  in  the 
literature. 

A.l  Statistical  Independence 

An  SSRV  X  =  [Xi,  X2,  heis  statistically  independent  components  A,- 

i  =  1, 2, . . . ,  A  if  and  only  if  the  SSRV  is  Gaussian. 

Proof:  Recall  that  the  PDF  of  X  can  be  expressed  as 

/x{x)  =  khN[{x\  +  +  . . .  +  x^)2]  =  (27r)"^  hM{Vx^x).  (A.l) 

If  the  components  of  X  are  statistically  independent,  then  the  PDF  given  by  eq  (A.l) 
must  factor  into  the  product  of  the  marginal  PDFs  of  the  components  of  X.  It  then 
follows  that 

hslixl  +  a:^  +  . . .  +  x^)2 ]  =  JJ ^(x,).  ( A.2) 

i=l 

Letting  r  =  (xj  +  Xj  +  . . .  +  xjf)2  and  differentiating  both  sides  of  eq  (A.2)  with 
respect  to  x,-,  results  in 

7^1v(^)=  n  (A.3) 

J  =  1 

j  7^  * 
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Dividing  both  sides  of  eq  (A. 3)  by  results  in 

h'^jr)  _  g'jxi) 
rhf^{r)  XigixiY 


(A.4) 


Equality  holds  in  eq  (A.4)  if  and  only  if  the  left  and  right  sides  of  eq  (A.4)  are  equal 
to  the  same  constant.  Denoting  this  constant  by  —A,  we  have 


rhs{r) 


(A.5) 


Integrating  both  sides  of  eq  (A.5)  with  respect  to  r  gives 

Ar^ 

hs{r)  =  aexp{ — —) 

where  a  is  the  constant  of  integration.  Hence, 


(A.6) 


^Ar[(a;i  +  X2  +  . . .  +  x^)5]  =  aexp[--{x\  +  +  . . .  +  x^)]  (A.7) 

Substitution  of  eq  (A.7)  in  eq  (A.l)clearly  results  in  the  Gaussian  PDF.  The  constraint 
of  unity  volume  under  the  PDF  results  in  a  =  A^. 

In  order  to  prove  the  sufficient  part  of  the  property,  we  start  with  the  PDF  of  a 
Gaussian  SSRV  X  given  by 


/x(x)  =  (y)  ^exp(-^^x^). 


Clearly  the  PDF  given  by  eq  (A.8)  can  be  expressed  as 


(A.8) 


/x(x) = n/x,(x() 


(A.9) 


where 


/x,(ii)  =  ( y)  ^eip(-^). 


(A.10) 


Hence,  the  sufficient  part  of  the  property  follows. 

An  alternate  proof  of  this  property  can  be  obtained  by  using  the  representation 
theorem.  The  representation  theorem  allows  us  to  express  the  SSRV  X  as  a  product 
of  a  Gaussian  random  vector  Z  having  zero  mean  and  identity  covariance  matrix  and 
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a  non-negative  random  variable  S.  More  precisely,  we  can  write 

X  =  Z5.  (A.ll) 

The  components  of  X  can  be  statistically  independent  if  and  only  if  S'  is  a  constant. 
When  5  is  a  constant,  X  is  a  Gaussian  SSRV.  As  is  often  the  case,  the  representation 
theorem  provides  a  simplified  approach  for  determining  properties  of  SIRVs. 

A.2  Spherically  Symmetric  Characteristic  function 

In  this  section,  we  prove  that  the  characteristic  function  of  an  SSRV  is  spherically 
symmetric. 

Proof:  We  consider  the  SSRV  X  =  [Xi,  X2,  ...,X^^]^.  From  the  representation 
theorem,  we  can  write  X  =  ZS  where  Z  is  a  Gaussian  random  vector  having  zero 
mean  and  identity  covariance  matrix  and  5  is  a  non-negative  random  variable  with 
PDF  fs{s).  The  characteristic  function  of  X  given  by 

=  E[exp{ju/X)]  (A.12) 

where  u;  =  [a>i,  a;2, . . . ,  can  be  expressed  as 

$x(w)  =  £5[^X|5=5(w)]  (A. 13) 

where  ^XfSssC^^)  =  E[exp{ju^Zs)].  However, 

.2  N 

E[exp{juj'^Zs)]  =  eip(— (A.14) 

^  .=1 

Using  eq  (A.14)  in  eq  (A. 13)  results  in 

2  N 

^x(w)  =  /  exp(-^^u;?)/5(s)ds.  (A.15) 

The  characteristic  function  given  by  eq  (A.15)  can  be  expressed  as  a  function  of 
Hence  it  is  spherically  symmetric. 
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A.3  Relationship  Between  Higher  Order  and  Lower  Order 
SIRV  PDFs 

In  this  section  we  examine  the  relationship  between  the  higher  order  and  lower 
order  SIRV  PDFs.  More  precisely  we  consider  an  SIRV  Y  =  [Yi,  Y2,  . . . ,  having 
mean  vector  /x,  covariance  matrix  S  and  characteristic  PDF  fs{s)-  The  PDF  of  Y  is 
given  by 

/Y(y)  =  (27r)“^|S|"U^(p)  (A. 16) 

where  p  =  (y  —  —  p)  and 

hs{p)  =  s~^exp{—^)fs{s)ds.  (A.17) 

The  vector  Y  can  be  partitioned  as  Y  =  [Yi^  Y2^]^  where  Yi  =  [Yi,  V2,  •  •  •  Ym]^ 
and  Y2  =  [Ym+i,  Ym+2,  •  •  •  Ya^]^.  Let  pi  and  p2  denote  the  mean  vectors  of  Yi  and 
Y2  respectively,  and  Si  and  S2  denote  the  corresponding  covariance  matrices.  We 
wish  to  obtain  the  PDF  of  Yi  from  the  PDF  of  Y  by  integrating  out  over  the  W  —  m 
random  variables  (i.e.,  the  components  of  Y2).  Let  pi  =  (yi  —  pi)^Sj^(yi  —  pi) 
and  p2  =  (y2  -  P2)’^S2  Vy2  -  P2).  The  PDF  of  Yi  is  given  by 

/Yi(yi)  =  (2’r)"^il)l"2  y*  s~^exp{--^)fs{s)dsdy2.  (A. 18) 

From  [26]  (pl7  eq.8,  pl8  eq.ll)  we  have 

(2:r)-?|i:ri  /_“  txp{-^)dy2  =  (27r)-f  (A.19) 

Using  eq  (A.19)  in  eq  (A. 18)  gives 

/Yi(y:)  =  (2ir)-T|E,i-5j(°°^-“eip(-^)/s(s)<is.  (A.20) 

The  PDF  of  Yi  can  be  expressed  as 

/Y,(yi)  =  (2ir)-¥|SirU„(p,)  ■  (A,21) 

where 

hmiPi)  =  ^  5~"*eip(-^)/5(s)ds.  (A.22) 
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Clearly,  hm{pi)  given  by  eq  (A.22)  can  be  obtained  from  eq  (A. 17)  by  simply  re¬ 
placing  N  hy  m  and  p  by  pi.  To  determine  the  PDF  of  Yi,  all  that  is  needed  is 
the  specification  of  its  mean  vector  and  covaricince  matrix.  As  a  special  case,  when 
m  =  1,  eq  (A.20)  gives  us  the  first  order  SIRV  PDF.  Therefore,  to  obtain  the  first 
order  SIRV  PDF  of  the  component  of  Y  stating  from  the  order  SIRV  PDF, 
we  simply  use  eq  (A.20)  with  m  =  1,  Si  =  and  pi  = 


148 


Appendix  B 

Computer  Generation  of  SIRVs 
Using  the  Rejection  Method 


B.l  Rejection  Method 

We  present  a  proof  of  the  rejection  procedure  [30]  used  for  generating  the  norm 
R  of  the  white  SIRV  X  in  Chapter  4.  In  many  instances,  it  is  likely  that  the  PDF 
of  a  random  variable  is  known  explicitly,  but  its  cumulative  distribution  function  is 
either  unknown  or  has  a  complicated  functional  form.  Consequently,  the  cumula¬ 
tive  distribution  function  cannot  be  inverted  easily.  Therefore,  the  use  of  the  inverse 
distribution  function  for  generating  the  random  variable  does  not  offer  a  practical  so¬ 
lution  for  this  problem.  Hence,  it  is  necessary  to  use  a  different  scheme  for  generating 
the  random  variable.  We  consider  the  problem  of  generating  a  sequence  of  random 
numbers  with  PDF  fnir)  of  a  random  variable  R,  in  terms  of  a  random  number 
sequence  with  PDF  of  a  random  variable  U\.  The  underlying  assumption  is 

that  the  random  number  sequence  from  the  PDF  of  U\  can  be  readily  generated. 

The  rejection  method  used  in  Chapter  4  is  based  on  the  relative  frequency  inter¬ 
pretation  of  the  conditional  PDF 


/i;,(txilA4)dui  = 


P {ui  <  f/i  ^  ui  -|-  dui, 

PGM) 


(B.l) 


of  a  random  variable  U\  given  the  event  AA.  Af  is  expressed  in  terms  of  the  ran¬ 
dom  variable  U\  and  another  random  variable  f/j  is  chosen  so  that  the  resulting 
conditional  PDF  /i;,(ui|Af)  equals  /R(r).  The  desired  sequence  is  generated  by  set¬ 
ting  R  —  U\  given  that  the  event  AA  heis  occurred  and  rejecting  U\  otherwise.  The 
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problem  hats  a  solution  only  if  the  domauns  of  r  and  u\  are  such  that  /R(r)  =  0  in 
every  interval  for  which  /c/,(ui)  =  0.  Therefore,  we  can  assume  that  the  ratio 
is  bounded  from  below  by  some  positive  constamt  a: 

>  a  >  0  for  every  Ui  (B.2) 

B.2  Rejection  Theorem 

It  is  desired  to  generate  a  random  variable  E  with  PDF  fR(r).  Let  t/i  be  any 
random  variable  with  PDF  such  that  =  0  whenever  /^(r)  =  0.  Let 

U2  be  a  uniformly  distributed  random  variable  on  the  interval  (0, 1).  If  the  random 
variables  Ui  and  U2  are  statistically  independent  and 

M  =  {U2<g{U,)}  (B.3) 
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We  can  express  the  numerator  of  eq  (B.l)  as 

P{ui  <  Ui  <  Af  }  =  J  “  0'fR{'^\)du\- 

(B.IO) 

Using  eqs  (B.9)  and  (B.IO)  in  eq  (B.l)  results  in  eq  (B.5). 

Thus,  we  have  the  following  algorithm  for  generating  the  sequence  of  random  num¬ 
bers  from  the  PDF  of  R. 

1.  Generate  U\  and  U^- 

2.  If  U2  <  o.j^y  then  Ux  =  R 

3.  Otherwise  reject  Ui. 

Refering  now  to  the  generation  of  saples  of  the  norm  R  in  Chapter  4,  note  that 
U\  and  U2  were  uniformly  distributed  random  variables.  Let  c  denote  the  maximum 
value  of  the  PDF  of  R  and  6  denote  a  finite  range  for  the  PDF  of  R  such  that  the 
area  under  the  curve  of  the  PDF  is  close  to  unity.  U\  \s  assumed  to  be  uniformly 
distributed  in  the  interval  (0,  b).  Clearly,  —  h'  blpu^(ui )  —  Therefore, 

a  =  ^.  Step  2  above  becomes:  Ifl/2  <  bc/uii^  ~  U\  =  R.  This  can  be 

rewritten  as:  If  CU2  <  then  U\  =  R.  For  ease  of  implementation,  this  latter 

form  is  used  in  conjunction  with  a  uniform  random  variable  U2  that  is  uniformly 
distributed  over  the  interval  (0,  c).  This  is  the  procedure  followed  in  Chapter  4. 

The  method  used  in  Chapter  4  becomes  inefficient  if  17i  is  rejected  frequently  in 
step  3,  resulting  in  the  necessity  to  generate  the  two  uniformly  distributed  random 
variables  of  step  1  an  inordinate  number  of  times.  This  problem  can  be  overcome  by 
using  for  Ui  a  PDF  which  bounds  the  PDF  of  R  and  satisfies  the  conditions  stated 
in  section  B.l  and  in  the  rejection  theorem.  Then  a  random  variable  from  this  PDF 
is  used  in  step  1  instead  of  the  uniform  random  variable  Ui. 

A  second  drawback  of  using  a  uniformly  distributed  random  variable  Ui  is  that  it 
may  not  be  possible  to  efficiently  generate  SIRVs  of  length  greater  than  8.  This  is  due 
to  the  fact  that  the  PDF  of  R  depends  on  N.  Consequently,  the  uniform  distribution 
for  Ui  may  not  satisfactorily  bound  tfie  PDF  of  the  norm  R  for  all  N.  This  drawback 
can  be  overcome  by  choosing  a  different  PDF  for  Ui  for  each  choice  of  TV,  such  that 
the  conditions  stated  in  section  B.l  and  in  the  rejection  theorem  are  satisfied.  This 
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method  would  require  the  use  of  an  exhaustive  table  which  tabulates  the  appropriate 
PDF  of  U\  for  each  desired  value  of  N . 

Finally,  it  is  pointed  out  that  by  using  a  composite  function  for  the  PDF  of  t/i, 
it  is  possible  to  improve  the  simulation  procedure  by  making  it  possible  to  generate 
random  numbers  from  the  body  and  the  tail  of  the  PDF  of  R.  These  issues  are 
suitable  topics  for  future  investigation  as  am  extension  of  this  work. 
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Appendix  C 

Meiximum  Likelihood  Estimation 
Involving  SIRVs 


The  objective  of  this  appendix  is  to  determine  maximum  likelihood  estimates  for  the 
mean  vector  and  covariance  matrix  of  an  N  dimensional  SIRV  obtained  by  sampling 
a  wide  sense  stationary  (WSS)  SIRP.  Ideally,  n  independent  data  vectors  Y,-,  i  = 
1,2, ...,n  should  be  processed  corresponding  to  n  independent  trials  of  the  basic 
experiment.  This  corresponds  to  the  sample  space  given  by  the  product 

/  = /i  X /j  X  ...  X /„  (C.l) 

where  /,-,  i  =  1, 2, . . . ,  n  denotes  the  ensemble  of  the  SIRP  and  is  obtained  from 
This  is  shown  in  Figure  C.l. 

However,  the  approach  becomes  unwieldy  from  a  practical  point  of  view  because  n 
ensembles  are  required.  An  alternate  approach  [49]  makes  use  of  a  single  ensemble  as 
shown  in  Figure  C.2,  where  Y  =  [Yf ,  Yj,  •  •  •  i  Y^]^  is  obtained  by  sampling  a  WSS 
SIRP  at  nN  time  instants,  such  that 


tmN+j  ^mN+k  — 

;,  A;=  l,2,...,iV  (C-2) 

m  =  1,2,  ...n  —  1 

and  the  Yj,  t  =  1, 2, . . . ,  n,  are  obtained  from  n  different  sample  functions  of  the  same 
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ensemble.  Due  to  this,  the  mean  of  Y  is 


a  =  [b^b^...,b^]^  (C.3) 

and 

f;((Yi  -  b)(Y^  -  b)’']  =  (C.4) 

where  Sjk  is  the  Kronecker  delta  function,  so  that  the  covariance  matrix  of  Y  is 

E  0  ...  0 

0  E  ...  0 

0  0  E  0  •  (C.5) 


0  0  0  E  J 

In  the  context  of  the  radar  problem,  we  consider  a  surveillance  volume  that  repre¬ 
sents  a  single  ensemble  for  the  SIRP.  Each  cell  within  the  volume  generates  a  sample 
function  of  the  SIRP.  The  data  vector  Yj  is  obtained  from  the  cell  of  the  vol¬ 
ume  by  sampling  at  the  time  instants  t(,_i);v+A:  shown  in  FigureC.2.  In  terms  of 
the  representation  theorem,  each  cell  corresponds  to  a  different  value  of  the  random 
variable  S  whose  density  function  is  the  characteristic  PDF  fs{s). 

The  PDF  of  Y  given  b  and  E  is 

/Y|b,E(y|b,  E)  =  (27r)"^|E|"^  A„Ar(p)  (G.6) 

where  p  =  (Y.-  -  a)^C-^(Y.  -  q)  =  -  b)^E-»(y,  -  b)  and 

Kn{p)  =  ^  exp{—^)fs{s)ds.  (C.7) 


Note  that  is  a  monotonically  decreasing  function  for  all  n  and  N. 


Since  p  is  a  scalar,  we  have 

V  =  Ei=i  (y;  -  b)^E-^  (yj  -  b) 

=  tr  YTj=x  (yj  -  b)^i:-^  [Yj  -  b) 

(C.8) 

where  <r(.)  denotes  the  trace  of  the  matrix  (.).  However,  for  any  two  square  matrices 

A  and  B, 

fr(AB)  =  tr(BA). 

(C.9) 

Consequently, 

p  =  tr(E-^G) 

(C.IO) 

where 

G  =  E(yj  -  b)(yi  -  b)^. 

i=i 

(C.ll) 

Thus,  we  have 

/Y|b,2:(y|b,S)  =  (2»)-‘^|S|-?ft„«((r(S-'G)l. 

(C.12) 

Let 

w  =  jzivi  -  y)(y;  -  yf. 
i=i 

(C.13) 

where 

1  " 

F=-i:yr 

"  J=1 

(C.14) 

Then,  we  can  express  p  as 

P  =  E"=.(yi-b)’'S-‘(y,-b) 

=  E”=i(y;  -  y  +  y  -  bfs-"  (yi  -  y  +  y  -  b) 

=  E”=.(yi-yfs-'(Y,-y) 

+EJ=,(yi-yfs-‘(y-b) 

+E”=,(y-bfs-'(yi-y) 

+  E”=,(y-b)’'s-'(y-b) 

(C.15) 
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However,  from  eq  (C.14), 


E;=,(yi-yfs-‘(F-b)  =  o 
E;=.(y-bfs-‘(yi-y)  =  0, 

Therefore, 

P  =  S(y;  -  (yj  -  y)  +  n(y  -  (y  -  b). 

i=i 

Using  eq  (C.9),  we  have 

p  =  (r(S-' W)  +  n(y  -  b)’’E-‘  (y  -  b). 


(C.16) 


(C.17) 

(C.18) 


Thus,  the  likelihood  function  for  b  and  S  can  be  expressed  as 

L{h,  E)  = /Y|b,i:(y|b,  E)  =  {27r)~^ \'S:\~^hnN{p)  (C.19) 

where  p  is  given  by  eq  (C.18).  We  first  prove  that  W  is  positive  definite  with  proba¬ 

bility  one.  We  can  express  W  as 

w  =  x;w.-  (C.20) 

1=1 

where  W,  =  (y,--y7)(yi-y7)^.  w  is  positive  definite  if  W,-,  i  =  1, 2, . . . ,  n  are  positive 
definite.  We  consider  a  vector  a  =  [gi,  02  . . .  g/v]^  such  that  g,  /  0,  i  =  1, 2, . . . ,  n. 
Then  W,-  is  positive  definite  if  and  only  if 

a^W.a  >0.  (C.21) 

We  have 

qi  =  a^Wja 

=  (C-22) 

=  Ef=i<-i(y«-w)P>o. 

However,  the  probability  of  Qi  =  0  is  zero.  Therefore,  W*  is  positive  definite  with 
probability  one.  It  follows  that  W  is  positive  definite  with  probability  one. 

Before  proceeding  with  the  maximum  likelihood  estimate  of  b  and  S,  we  present 
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aji  important  lemma  [49]  which  is  useful  for  the  meiximization  problem. 

Lemma:  Let  g{.)  be  a  monotonically  decreasing  differentiable  function  such  that 
cg{x\  +  X2  +  . . .  +  x^)  is  a  PDF  of^  =  X2  •  ■  .XkY,  where  c  is  a  non-zero 
constant.  Then  the  function  h{x)  =  g[x)  for  x  >  0  has  a  Tnaximum  at  some 
finite  xq  and  is  a  solution  of 

9\x)  +  ^9{x)  =  0.  (C.23) 

Proof:  Since  cg{.)  is  a  PDF, 

/OO  fOO  1 

•••  /  9(^A)d^\---dxK  =  -  <00.  (C.24) 

•OO  •/— 00  C 

Also,  using  the  transformation  to  generalized  spherical  coordinates  of  eq  (2.22)  and 


integrating  over  6  and  A;  =  1, 2, . . .  A'  -  2,  it  follows  that 

/  •••/  ...dxK- = -^  /  2r^-'^ g{r'^)dr.  (C.25) 

J-oo  J-oo  l(y)yO 

Making  the  change  of  variable  =  a,  we  have 

K 

yoo  ^  ^2“  TOO 

•••/  9(^^])dxi...dxK  =  I  a'2~'^g{a)dQ.  (C.26) 

-OO  J-oo  ;_j  1  ( Y  j  ./O 

Since  g{.)  is  a  monotonically  decrecising  function, 

^(2x)[2x  -  x]  =  xg{2x)  <  f  g{t)dt.  (C.27) 

Jx 

Hence, 

2“'^(2x)^5r(2x)  =  x^5'(2x)  <  x^-i  j  g{t)dt.  (C.28) 

Since  g{.)  is  a  monotonically  decreasing  function, 

x^g{2x)  <  x^-^  J  g{t)dt<J  tT-'^g{t)dt.  (C.29) 


Since  1 2  ~^g{t)  is  the  PDF  of  t  xj,  to  within  a  multiplicative  constant,  and 
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since  the  PDF  oft— ♦Oast— »oo  (see  Chapter  3  for  details),  it  follows  that 

J  t^~^g{t)dt  — ♦  0  as  X  — ♦  00.  (C.30) 

Also,  h{0)  =  0  and  h{x)  >  0  Vx  >  0.  Therefore,  h{x)  has  a  majdmum  at  some  finite 
xo  >  0.  The  first  assertion  of  the  lemma  follows.  Differentiating  h{x)  with  respect  to 
X,  we  have 

h'{x)  =  (C.31) 

Since  h{x)  has  a  maximum  at  some  finite  xq  >  0,  it  follows  that  xq  is  a  solution  to 
the  equation 

:^9M  +  gi^o)  =  0.  (C.32) 

ZXq 

Letting  K  =  nN  and  x  =  y,  we  have  /i(y)  =  If  follows  from  the 

above  lemma  that  the  function 

/(A)  =  (C.33) 

arrives  at  its  maximum  at  some  finite  positive  Aq  and  arises  as  a  solution  of 

nAo  ,N .  >,N ,  ^ 

+  S' ( -j)  =  0  (C.34) 

We  now  return  to  the  problem  of  maximization  of  L(b,  S).  Since  /inv(-)  is  a 
monotonically  decreasing  function  and  S  is  positive  definite  with  probability  one, 
i(b,  S)  arrives  at  its  maximum  when  b  =  y.  We  then  focus  on  the  concentrated 
likelihood  function 

L(b,  S)  =  (27r)-'^|S|-T/i„;vNS-iW)].  (C.35) 


Since  W  is  a  positive  definite  matrix,  it  can  be  represented  cis  W  =  CC^  where  C  is 
a  nonsinguleir  matrix.  We  define  the  matrix  E  =  so  that  E  =  CEC^. 

Also,  it  follows  that 


tr(E-iW)  =  tr[(CSCT)-^W]  =  tr{t-^[CC'^]-^W)  =  tr(S-^) 


PI  =  |CSCT|  =  |S||W| 


(C.36) 
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Hence,  the  likelihood  function  can  be  rewritten  as 


I(b,  S)  =  (27r)-^|W|-?|i:|-t/iniv[^r(X:-')].  (C.37) 

Let  A,-  >  0,  z  =  1, 2, ...  TV  denote  the  eigen  values  of  S.  Then, 

i(b,  S)  =  (2x)-'^|W|-?(n£.  A-')-f k') 

(C.3o) 

=  (2x)-'#|w|-j(nLAr*)-'^'‘n«(EL  A-’) 

Since  the  arithmetic  mean  is  always  greater  than  or  equal  to  the  geometric  mean,  it 
follows  that 

i(b,  E)  <  (2T)-^|Wl-t(A)^/i„A^(TVA)  (C.39) 

where  A  =  ^  •  Equality  between  the  arithmetic  and  geometric  mean  holds 

only  if  Ai  =  A2  =  . . .  =  A;v  =  A.  Therefore,  L(b,  S)  arrives  at  its  maximum  when 
the  eigen  values  of  E  are  equal.  Consequently, 

maxL{h,  E)  =  maa;(27r)“'^|W|~TA~^/i„7v(x) 

=  max{2'K)~^\X'W\~^hnN{^)  (C.40) 

=  max(27r)-^|W|-T/(A). 

where  /(A)  is  given  by  eq  (C.33)  with  g{.)  replaced  by  hnN{-)-  Note  that  /injv(-) 
satisfies  ail  the  conditions  of  the  lemma  dealing  with  the  maximization  of  h{.).  Let 
the  value  of  A  resulting  in  the  maximum  be  denoted  by  Aq.  Comparing  eq  (C.40) 
with  eq  (C.33),  it  follows  that  the  maximum  likelihood  estimate  of  E  is 

S  =  AoW.  (C.41) 

In  summary,  the  maximum  likelihood  estimates  of  b  and  E  are: 


b  =  y 
S  =  AoW 


(C.42) 


A 

In  order  to  guarantee  the  non-negative  definite  property  of  E,  it  is  required  that 
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